2023-02-16 17:00:56,861 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-16 17:00:56,917 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=163, ProcessCount=167, AvailableMemoryMB=3593 2023-02-16 17:00:57,208 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243 2023-02-16 17:00:57,219 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 17:00:57,219 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/cluster_aa4ed667-b63b-e045-1ed5-982b85dea6e2, deleteOnExit=true 2023-02-16 17:00:57,220 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 17:00:57,220 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/test.cache.data in system properties and HBase conf 2023-02-16 17:00:57,221 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 17:00:57,222 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/hadoop.log.dir in system properties and HBase conf 2023-02-16 17:00:57,222 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 17:00:57,223 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 17:00:57,223 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 17:00:57,343 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-16 17:00:57,765 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 17:00:57,770 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:00:57,770 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:00:57,771 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 17:00:57,771 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:00:57,771 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 17:00:57,771 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 17:00:57,772 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:00:57,772 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:00:57,772 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 17:00:57,772 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/nfs.dump.dir in system properties and HBase conf 2023-02-16 17:00:57,773 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/java.io.tmpdir in system properties and HBase conf 2023-02-16 17:00:57,773 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:00:57,773 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 17:00:57,773 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 17:00:58,419 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:00:58,426 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:00:58,783 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-16 17:00:58,967 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-16 17:00:58,985 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:00:59,033 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:00:59,070 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/java.io.tmpdir/Jetty_localhost_33833_hdfs____2rg6hu/webapp 2023-02-16 17:00:59,216 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33833 2023-02-16 17:00:59,255 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:00:59,255 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:00:59,773 WARN [Listener at localhost/40299] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:00:59,860 WARN [Listener at localhost/40299] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:00:59,887 WARN [Listener at localhost/40299] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:00:59,895 INFO [Listener at localhost/40299] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:00:59,904 INFO [Listener at localhost/40299] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/java.io.tmpdir/Jetty_localhost_42681_datanode____32om3c/webapp 2023-02-16 17:01:00,079 INFO [Listener at localhost/40299] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42681 2023-02-16 17:01:00,500 WARN [Listener at localhost/33457] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:00,518 WARN [Listener at localhost/33457] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:00,521 WARN [Listener at localhost/33457] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:00,523 INFO [Listener at localhost/33457] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:00,529 INFO [Listener at localhost/33457] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/java.io.tmpdir/Jetty_localhost_35141_datanode____67i7jn/webapp 2023-02-16 17:01:00,636 INFO [Listener at localhost/33457] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35141 2023-02-16 17:01:00,647 WARN [Listener at localhost/43373] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:01,045 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf769621a2077c5f8: Processing first storage report for DS-fa0439dd-fa68-4a49-9f4d-21720e16a814 from datanode 4d02dc30-043b-431d-b7bc-e56e8fb45b4e 2023-02-16 17:01:01,048 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf769621a2077c5f8: from storage DS-fa0439dd-fa68-4a49-9f4d-21720e16a814 node DatanodeRegistration(127.0.0.1:42525, datanodeUuid=4d02dc30-043b-431d-b7bc-e56e8fb45b4e, infoPort=38599, infoSecurePort=0, ipcPort=33457, storageInfo=lv=-57;cid=testClusterID;nsid=946290757;c=1676566858537), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-02-16 17:01:01,048 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcdafe53121cf0a52: Processing first storage report for DS-66b66d56-f2d2-4d7c-bb06-d25318120509 from datanode 7e67da74-6bbc-4acd-837b-979ff532293a 2023-02-16 17:01:01,048 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcdafe53121cf0a52: from storage DS-66b66d56-f2d2-4d7c-bb06-d25318120509 node DatanodeRegistration(127.0.0.1:46755, datanodeUuid=7e67da74-6bbc-4acd-837b-979ff532293a, infoPort=37081, infoSecurePort=0, ipcPort=43373, storageInfo=lv=-57;cid=testClusterID;nsid=946290757;c=1676566858537), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:01,049 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf769621a2077c5f8: Processing first storage report for DS-6e10d5c0-7c6c-4e97-9239-3567c094f40c from datanode 4d02dc30-043b-431d-b7bc-e56e8fb45b4e 2023-02-16 17:01:01,049 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf769621a2077c5f8: from storage DS-6e10d5c0-7c6c-4e97-9239-3567c094f40c node DatanodeRegistration(127.0.0.1:42525, datanodeUuid=4d02dc30-043b-431d-b7bc-e56e8fb45b4e, infoPort=38599, infoSecurePort=0, ipcPort=33457, storageInfo=lv=-57;cid=testClusterID;nsid=946290757;c=1676566858537), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:01,049 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcdafe53121cf0a52: Processing first storage report for DS-fb142fcb-9f30-4537-9213-a7bd1375d126 from datanode 7e67da74-6bbc-4acd-837b-979ff532293a 2023-02-16 17:01:01,049 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcdafe53121cf0a52: from storage DS-fb142fcb-9f30-4537-9213-a7bd1375d126 node DatanodeRegistration(127.0.0.1:46755, datanodeUuid=7e67da74-6bbc-4acd-837b-979ff532293a, infoPort=37081, infoSecurePort=0, ipcPort=43373, storageInfo=lv=-57;cid=testClusterID;nsid=946290757;c=1676566858537), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:01,127 DEBUG [Listener at localhost/43373] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243 2023-02-16 17:01:01,228 INFO [Listener at localhost/43373] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/cluster_aa4ed667-b63b-e045-1ed5-982b85dea6e2/zookeeper_0, clientPort=50419, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/cluster_aa4ed667-b63b-e045-1ed5-982b85dea6e2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/cluster_aa4ed667-b63b-e045-1ed5-982b85dea6e2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 17:01:01,246 INFO [Listener at localhost/43373] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50419 2023-02-16 17:01:01,254 INFO [Listener at localhost/43373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:01,256 INFO [Listener at localhost/43373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:01,944 INFO [Listener at localhost/43373] util.FSUtils(479): Created version file at hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c with version=8 2023-02-16 17:01:01,945 INFO [Listener at localhost/43373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:01,947 INFO [Listener at localhost/43373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:01,952 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/hbase-staging 2023-02-16 17:01:02,292 INFO [Listener at localhost/43373] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-16 17:01:02,785 INFO [Listener at localhost/43373] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:02,818 INFO [Listener at localhost/43373] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:02,819 INFO [Listener at localhost/43373] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:02,819 INFO [Listener at localhost/43373] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:02,819 INFO [Listener at localhost/43373] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:02,819 INFO [Listener at localhost/43373] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:02,957 INFO [Listener at localhost/43373] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:03,027 DEBUG [Listener at localhost/43373] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-16 17:01:03,119 INFO [Listener at localhost/43373] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40495 2023-02-16 17:01:03,129 INFO [Listener at localhost/43373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:03,131 INFO [Listener at localhost/43373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:03,153 INFO [Listener at localhost/43373] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40495 connecting to ZooKeeper ensemble=127.0.0.1:50419 2023-02-16 17:01:03,206 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:404950x0, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:03,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40495-0x1005e13ff5d0000 connected 2023-02-16 17:01:03,246 DEBUG [Listener at localhost/43373] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:03,247 DEBUG [Listener at localhost/43373] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:03,252 DEBUG [Listener at localhost/43373] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:03,268 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40495 2023-02-16 17:01:03,269 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40495 2023-02-16 17:01:03,272 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40495 2023-02-16 17:01:03,279 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40495 2023-02-16 17:01:03,279 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40495 2023-02-16 17:01:03,287 INFO [Listener at localhost/43373] master.HMaster(444): hbase.rootdir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c, hbase.cluster.distributed=false 2023-02-16 17:01:03,390 INFO [Listener at localhost/43373] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:03,391 INFO [Listener at localhost/43373] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:03,391 INFO [Listener at localhost/43373] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:03,391 INFO [Listener at localhost/43373] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:03,391 INFO [Listener at localhost/43373] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:03,392 INFO [Listener at localhost/43373] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:03,398 INFO [Listener at localhost/43373] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:03,402 INFO [Listener at localhost/43373] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34397 2023-02-16 17:01:03,406 INFO [Listener at localhost/43373] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:03,416 DEBUG [Listener at localhost/43373] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:03,417 INFO [Listener at localhost/43373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:03,420 INFO [Listener at localhost/43373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:03,423 INFO [Listener at localhost/43373] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34397 connecting to ZooKeeper ensemble=127.0.0.1:50419 2023-02-16 17:01:03,432 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:343970x0, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:03,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34397-0x1005e13ff5d0001 connected 2023-02-16 17:01:03,434 DEBUG [Listener at localhost/43373] zookeeper.ZKUtil(164): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:03,436 DEBUG [Listener at localhost/43373] zookeeper.ZKUtil(164): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:03,437 DEBUG [Listener at localhost/43373] zookeeper.ZKUtil(164): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:03,444 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34397 2023-02-16 17:01:03,444 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34397 2023-02-16 17:01:03,445 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34397 2023-02-16 17:01:03,448 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34397 2023-02-16 17:01:03,448 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34397 2023-02-16 17:01:03,468 INFO [Listener at localhost/43373] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:03,468 INFO [Listener at localhost/43373] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:03,468 INFO [Listener at localhost/43373] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:03,469 INFO [Listener at localhost/43373] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:03,470 INFO [Listener at localhost/43373] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:03,470 INFO [Listener at localhost/43373] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:03,470 INFO [Listener at localhost/43373] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:03,473 INFO [Listener at localhost/43373] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41601 2023-02-16 17:01:03,474 INFO [Listener at localhost/43373] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:03,477 DEBUG [Listener at localhost/43373] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:03,478 INFO [Listener at localhost/43373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:03,481 INFO [Listener at localhost/43373] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:03,484 INFO [Listener at localhost/43373] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41601 connecting to ZooKeeper ensemble=127.0.0.1:50419 2023-02-16 17:01:03,492 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:416010x0, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:03,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41601-0x1005e13ff5d0002 connected 2023-02-16 17:01:03,494 DEBUG [Listener at localhost/43373] zookeeper.ZKUtil(164): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:03,495 DEBUG [Listener at localhost/43373] zookeeper.ZKUtil(164): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:03,496 DEBUG [Listener at localhost/43373] zookeeper.ZKUtil(164): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:03,500 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41601 2023-02-16 17:01:03,500 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41601 2023-02-16 17:01:03,502 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41601 2023-02-16 17:01:03,503 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41601 2023-02-16 17:01:03,504 DEBUG [Listener at localhost/43373] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41601 2023-02-16 17:01:03,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40495,1676566862134 2023-02-16 17:01:03,524 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:03,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40495,1676566862134 2023-02-16 17:01:03,552 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:03,552 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:03,552 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:03,553 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:03,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:03,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40495,1676566862134 from backup master directory 2023-02-16 17:01:03,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:03,560 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40495,1676566862134 2023-02-16 17:01:03,561 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:03,562 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:03,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40495,1676566862134 2023-02-16 17:01:03,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-16 17:01:03,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-16 17:01:03,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/hbase.id with ID: 48ed82d1-d79d-499e-aab1-915583452f7d 2023-02-16 17:01:03,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:03,723 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:03,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x375d7a7e to 127.0.0.1:50419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:03,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46571b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:03,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:03,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 17:01:03,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-16 17:01:03,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-16 17:01:03,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-16 17:01:03,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-16 17:01:03,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:03,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/data/master/store-tmp 2023-02-16 17:01:03,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:03,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:03,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:03,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:03,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:03,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:03,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:03,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:03,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/WALs/jenkins-hbase4.apache.org,40495,1676566862134 2023-02-16 17:01:03,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40495%2C1676566862134, suffix=, logDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/WALs/jenkins-hbase4.apache.org,40495,1676566862134, archiveDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/oldWALs, maxLogs=10 2023-02-16 17:01:04,004 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46755,DS-66b66d56-f2d2-4d7c-bb06-d25318120509,DISK] 2023-02-16 17:01:04,004 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42525,DS-fa0439dd-fa68-4a49-9f4d-21720e16a814,DISK] 2023-02-16 17:01:04,012 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-16 17:01:04,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/WALs/jenkins-hbase4.apache.org,40495,1676566862134/jenkins-hbase4.apache.org%2C40495%2C1676566862134.1676566863951 2023-02-16 17:01:04,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42525,DS-fa0439dd-fa68-4a49-9f4d-21720e16a814,DISK], DatanodeInfoWithStorage[127.0.0.1:46755,DS-66b66d56-f2d2-4d7c-bb06-d25318120509,DISK]] 2023-02-16 17:01:04,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:04,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:04,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:04,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:04,149 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:04,155 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 17:01:04,182 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 17:01:04,197 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:04,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:04,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:04,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:04,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:04,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74815936, jitterRate=0.11484432220458984}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:04,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:04,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 17:01:04,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 17:01:04,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 17:01:04,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 17:01:04,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-16 17:01:04,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 48 msec 2023-02-16 17:01:04,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 17:01:04,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 17:01:04,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 17:01:04,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 17:01:04,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 17:01:04,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 17:01:04,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 17:01:04,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 17:01:04,384 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:04,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 17:01:04,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 17:01:04,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 17:01:04,405 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:04,405 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:04,405 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:04,405 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:04,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40495,1676566862134, sessionid=0x1005e13ff5d0000, setting cluster-up flag (Was=false) 2023-02-16 17:01:04,429 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:04,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 17:01:04,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40495,1676566862134 2023-02-16 17:01:04,443 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:04,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 17:01:04,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40495,1676566862134 2023-02-16 17:01:04,454 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.hbase-snapshot/.tmp 2023-02-16 17:01:04,512 INFO [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(952): ClusterId : 48ed82d1-d79d-499e-aab1-915583452f7d 2023-02-16 17:01:04,512 INFO [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(952): ClusterId : 48ed82d1-d79d-499e-aab1-915583452f7d 2023-02-16 17:01:04,518 DEBUG [RS:0;jenkins-hbase4:34397] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:04,518 DEBUG [RS:1;jenkins-hbase4:41601] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:04,526 DEBUG [RS:1;jenkins-hbase4:41601] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:04,526 DEBUG [RS:0;jenkins-hbase4:34397] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:04,526 DEBUG [RS:1;jenkins-hbase4:41601] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:04,526 DEBUG [RS:0;jenkins-hbase4:34397] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:04,531 DEBUG [RS:0;jenkins-hbase4:34397] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:04,531 DEBUG [RS:1;jenkins-hbase4:41601] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:04,532 DEBUG [RS:1;jenkins-hbase4:41601] zookeeper.ReadOnlyZKClient(139): Connect 0x6c983de1 to 127.0.0.1:50419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:04,532 DEBUG [RS:0;jenkins-hbase4:34397] zookeeper.ReadOnlyZKClient(139): Connect 0x1e4bd4eb to 127.0.0.1:50419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:04,539 DEBUG [RS:0;jenkins-hbase4:34397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@108c2952, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:04,540 DEBUG [RS:1;jenkins-hbase4:41601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@625fce02, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:04,540 DEBUG [RS:0;jenkins-hbase4:34397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14b3bf9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:04,540 DEBUG [RS:1;jenkins-hbase4:41601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66605691, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:04,567 DEBUG [RS:1;jenkins-hbase4:41601] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41601 2023-02-16 17:01:04,567 DEBUG [RS:0;jenkins-hbase4:34397] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34397 2023-02-16 17:01:04,572 INFO [RS:1;jenkins-hbase4:41601] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:04,573 INFO [RS:1;jenkins-hbase4:41601] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:04,572 INFO [RS:0;jenkins-hbase4:34397] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:04,573 INFO [RS:0;jenkins-hbase4:34397] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:04,573 DEBUG [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:04,573 DEBUG [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:04,576 INFO [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40495,1676566862134 with isa=jenkins-hbase4.apache.org/172.31.14.131:34397, startcode=1676566863389 2023-02-16 17:01:04,576 INFO [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40495,1676566862134 with isa=jenkins-hbase4.apache.org/172.31.14.131:41601, startcode=1676566863467 2023-02-16 17:01:04,595 DEBUG [RS:0;jenkins-hbase4:34397] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:04,595 DEBUG [RS:1;jenkins-hbase4:41601] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:04,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:04,648 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55831, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:04,648 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60499, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:04,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:04,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:04,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:04,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:04,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 17:01:04,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:04,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:04,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:04,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40495] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 17:01:04,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676566894657 2023-02-16 17:01:04,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 17:01:04,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 17:01:04,664 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:04,665 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 17:01:04,670 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:04,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 17:01:04,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 17:01:04,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 17:01:04,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 17:01:04,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 17:01:04,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:04,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 17:01:04,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 17:01:04,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 17:01:04,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 17:01:04,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 17:01:04,692 DEBUG [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(2829): Master is not running yet 2023-02-16 17:01:04,692 DEBUG [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(2829): Master is not running yet 2023-02-16 17:01:04,692 WARN [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-16 17:01:04,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566864690,5,FailOnTimeoutGroup] 2023-02-16 17:01:04,692 WARN [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-16 17:01:04,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566864693,5,FailOnTimeoutGroup] 2023-02-16 17:01:04,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:04,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 17:01:04,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:04,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:04,711 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:04,712 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:04,712 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c 2023-02-16 17:01:04,728 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:04,730 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:04,733 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/info 2023-02-16 17:01:04,734 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:04,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:04,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:04,739 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:04,739 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:04,740 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:04,740 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:04,743 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/table 2023-02-16 17:01:04,743 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:04,744 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:04,745 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740 2023-02-16 17:01:04,746 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740 2023-02-16 17:01:04,750 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:04,752 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:04,756 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:04,757 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61766523, jitterRate=-0.07960708439350128}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:04,757 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:04,757 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:04,757 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:04,757 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:04,757 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:04,757 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:04,759 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:04,759 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:04,765 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:04,765 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 17:01:04,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 17:01:04,792 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 17:01:04,795 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 17:01:04,945 WARN [jenkins-hbase4:40495] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-16 17:01:05,693 INFO [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40495,1676566862134 with isa=jenkins-hbase4.apache.org/172.31.14.131:34397, startcode=1676566863389 2023-02-16 17:01:05,694 INFO [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40495,1676566862134 with isa=jenkins-hbase4.apache.org/172.31.14.131:41601, startcode=1676566863467 2023-02-16 17:01:05,700 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:05,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40495] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:05,707 DEBUG [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c 2023-02-16 17:01:05,707 DEBUG [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c 2023-02-16 17:01:05,707 DEBUG [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40299 2023-02-16 17:01:05,707 DEBUG [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40299 2023-02-16 17:01:05,707 DEBUG [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:05,707 DEBUG [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:05,717 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:05,718 DEBUG [RS:1;jenkins-hbase4:41601] zookeeper.ZKUtil(162): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:05,718 DEBUG [RS:0;jenkins-hbase4:34397] zookeeper.ZKUtil(162): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:05,718 WARN [RS:1;jenkins-hbase4:41601] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:05,718 WARN [RS:0;jenkins-hbase4:34397] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:05,719 INFO [RS:1;jenkins-hbase4:41601] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:05,719 INFO [RS:0;jenkins-hbase4:34397] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:05,719 DEBUG [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/WALs/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:05,719 DEBUG [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/WALs/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:05,720 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34397,1676566863389] 2023-02-16 17:01:05,720 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41601,1676566863467] 2023-02-16 17:01:05,730 DEBUG [RS:0;jenkins-hbase4:34397] zookeeper.ZKUtil(162): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:05,730 DEBUG [RS:1;jenkins-hbase4:41601] zookeeper.ZKUtil(162): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:05,731 DEBUG [RS:0;jenkins-hbase4:34397] zookeeper.ZKUtil(162): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:05,731 DEBUG [RS:1;jenkins-hbase4:41601] zookeeper.ZKUtil(162): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:05,742 DEBUG [RS:1;jenkins-hbase4:41601] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:05,742 DEBUG [RS:0;jenkins-hbase4:34397] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:05,752 INFO [RS:1;jenkins-hbase4:41601] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:05,752 INFO [RS:0;jenkins-hbase4:34397] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:05,773 INFO [RS:0;jenkins-hbase4:34397] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:05,773 INFO [RS:1;jenkins-hbase4:41601] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:05,778 INFO [RS:0;jenkins-hbase4:34397] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:05,778 INFO [RS:1;jenkins-hbase4:41601] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:05,778 INFO [RS:0;jenkins-hbase4:34397] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:05,778 INFO [RS:1;jenkins-hbase4:41601] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:05,779 INFO [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:05,779 INFO [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:05,788 INFO [RS:1;jenkins-hbase4:41601] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:05,788 INFO [RS:0;jenkins-hbase4:34397] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:05,788 DEBUG [RS:1;jenkins-hbase4:41601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,789 DEBUG [RS:0;jenkins-hbase4:34397] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,789 DEBUG [RS:1;jenkins-hbase4:41601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,789 DEBUG [RS:0;jenkins-hbase4:34397] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,789 DEBUG [RS:1;jenkins-hbase4:41601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,789 DEBUG [RS:0;jenkins-hbase4:34397] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,789 DEBUG [RS:1;jenkins-hbase4:41601] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,789 DEBUG [RS:0;jenkins-hbase4:34397] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,789 DEBUG [RS:1;jenkins-hbase4:41601] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,789 DEBUG [RS:0;jenkins-hbase4:34397] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,789 DEBUG [RS:1;jenkins-hbase4:41601] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:05,790 DEBUG [RS:0;jenkins-hbase4:34397] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:05,790 DEBUG [RS:1;jenkins-hbase4:41601] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,790 DEBUG [RS:0;jenkins-hbase4:34397] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,790 DEBUG [RS:1;jenkins-hbase4:41601] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,790 DEBUG [RS:0;jenkins-hbase4:34397] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,790 DEBUG [RS:1;jenkins-hbase4:41601] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,790 DEBUG [RS:0;jenkins-hbase4:34397] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,790 DEBUG [RS:1;jenkins-hbase4:41601] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,790 DEBUG [RS:0;jenkins-hbase4:34397] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:05,791 INFO [RS:0;jenkins-hbase4:34397] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:05,791 INFO [RS:1;jenkins-hbase4:41601] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:05,791 INFO [RS:0;jenkins-hbase4:34397] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:05,791 INFO [RS:1;jenkins-hbase4:41601] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:05,792 INFO [RS:0;jenkins-hbase4:34397] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:05,792 INFO [RS:1;jenkins-hbase4:41601] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:05,807 INFO [RS:0;jenkins-hbase4:34397] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:05,809 INFO [RS:1;jenkins-hbase4:41601] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:05,811 INFO [RS:0;jenkins-hbase4:34397] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34397,1676566863389-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:05,811 INFO [RS:1;jenkins-hbase4:41601] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41601,1676566863467-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:05,835 INFO [RS:0;jenkins-hbase4:34397] regionserver.Replication(203): jenkins-hbase4.apache.org,34397,1676566863389 started 2023-02-16 17:01:05,835 INFO [RS:1;jenkins-hbase4:41601] regionserver.Replication(203): jenkins-hbase4.apache.org,41601,1676566863467 started 2023-02-16 17:01:05,835 INFO [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34397,1676566863389, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34397, sessionid=0x1005e13ff5d0001 2023-02-16 17:01:05,835 INFO [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41601,1676566863467, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41601, sessionid=0x1005e13ff5d0002 2023-02-16 17:01:05,835 DEBUG [RS:0;jenkins-hbase4:34397] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:05,835 DEBUG [RS:1;jenkins-hbase4:41601] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:05,835 DEBUG [RS:0;jenkins-hbase4:34397] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:05,835 DEBUG [RS:1;jenkins-hbase4:41601] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:05,836 DEBUG [RS:0;jenkins-hbase4:34397] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34397,1676566863389' 2023-02-16 17:01:05,836 DEBUG [RS:1;jenkins-hbase4:41601] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41601,1676566863467' 2023-02-16 17:01:05,837 DEBUG [RS:0;jenkins-hbase4:34397] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:05,837 DEBUG [RS:1;jenkins-hbase4:41601] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:05,837 DEBUG [RS:1;jenkins-hbase4:41601] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:05,837 DEBUG [RS:0;jenkins-hbase4:34397] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:05,838 DEBUG [RS:1;jenkins-hbase4:41601] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:05,838 DEBUG [RS:1;jenkins-hbase4:41601] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:05,838 DEBUG [RS:0;jenkins-hbase4:34397] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:05,838 DEBUG [RS:1;jenkins-hbase4:41601] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:05,838 DEBUG [RS:1;jenkins-hbase4:41601] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41601,1676566863467' 2023-02-16 17:01:05,838 DEBUG [RS:1;jenkins-hbase4:41601] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:05,839 DEBUG [RS:1;jenkins-hbase4:41601] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:05,838 DEBUG [RS:0;jenkins-hbase4:34397] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:05,839 DEBUG [RS:0;jenkins-hbase4:34397] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:05,840 DEBUG [RS:0;jenkins-hbase4:34397] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34397,1676566863389' 2023-02-16 17:01:05,840 DEBUG [RS:0;jenkins-hbase4:34397] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:05,840 DEBUG [RS:1;jenkins-hbase4:41601] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:05,840 INFO [RS:1;jenkins-hbase4:41601] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:05,840 INFO [RS:1;jenkins-hbase4:41601] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:05,840 DEBUG [RS:0;jenkins-hbase4:34397] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:05,841 DEBUG [RS:0;jenkins-hbase4:34397] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:05,841 INFO [RS:0;jenkins-hbase4:34397] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:05,841 INFO [RS:0;jenkins-hbase4:34397] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:05,948 DEBUG [jenkins-hbase4:40495] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 17:01:05,952 DEBUG [jenkins-hbase4:40495] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:05,958 DEBUG [jenkins-hbase4:40495] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:05,958 DEBUG [jenkins-hbase4:40495] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:05,958 DEBUG [jenkins-hbase4:40495] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:05,961 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41601,1676566863467, state=OPENING 2023-02-16 17:01:05,969 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 17:01:05,971 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:05,971 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:05,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41601,1676566863467}] 2023-02-16 17:01:06,162 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:06,164 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:06,168 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58426, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:06,180 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 17:01:06,180 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:06,183 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41601%2C1676566863467.meta, suffix=.meta, logDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/WALs/jenkins-hbase4.apache.org,41601,1676566863467, archiveDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/oldWALs, maxLogs=32 2023-02-16 17:01:06,205 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46755,DS-66b66d56-f2d2-4d7c-bb06-d25318120509,DISK] 2023-02-16 17:01:06,205 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42525,DS-fa0439dd-fa68-4a49-9f4d-21720e16a814,DISK] 2023-02-16 17:01:06,209 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/WALs/jenkins-hbase4.apache.org,41601,1676566863467/jenkins-hbase4.apache.org%2C41601%2C1676566863467.meta.1676566866187.meta 2023-02-16 17:01:06,209 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46755,DS-66b66d56-f2d2-4d7c-bb06-d25318120509,DISK], DatanodeInfoWithStorage[127.0.0.1:42525,DS-fa0439dd-fa68-4a49-9f4d-21720e16a814,DISK]] 2023-02-16 17:01:06,210 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:06,211 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 17:01:06,232 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 17:01:06,239 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 17:01:06,245 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 17:01:06,245 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:06,245 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 17:01:06,245 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 17:01:06,249 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:06,251 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/info 2023-02-16 17:01:06,251 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/info 2023-02-16 17:01:06,251 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:06,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:06,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:06,255 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:06,255 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:06,256 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:06,257 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:06,257 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:06,259 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/table 2023-02-16 17:01:06,259 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/table 2023-02-16 17:01:06,259 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:06,260 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:06,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740 2023-02-16 17:01:06,266 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740 2023-02-16 17:01:06,270 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:06,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:06,274 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62988712, jitterRate=-0.06139504909515381}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:06,274 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:06,286 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676566866154 2023-02-16 17:01:06,307 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 17:01:06,308 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 17:01:06,309 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41601,1676566863467, state=OPEN 2023-02-16 17:01:06,313 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 17:01:06,313 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:06,318 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 17:01:06,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41601,1676566863467 in 338 msec 2023-02-16 17:01:06,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 17:01:06,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5430 sec 2023-02-16 17:01:06,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.7980 sec 2023-02-16 17:01:06,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676566866334, completionTime=-1 2023-02-16 17:01:06,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 17:01:06,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 17:01:06,406 DEBUG [hconnection-0x168f23c1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:06,409 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58434, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:06,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 17:01:06,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676566926432 2023-02-16 17:01:06,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676566986432 2023-02-16 17:01:06,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 97 msec 2023-02-16 17:01:06,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40495,1676566862134-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:06,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40495,1676566862134-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:06,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40495,1676566862134-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:06,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40495, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:06,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:06,520 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 17:01:06,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 17:01:06,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:06,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 17:01:06,540 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:06,544 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:06,568 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:06,572 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2 empty. 2023-02-16 17:01:06,573 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:06,573 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 17:01:06,603 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:06,605 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 12266b3361a4f74b5085bf05d1d5cbb2, NAME => 'hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp 2023-02-16 17:01:06,625 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:06,625 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 12266b3361a4f74b5085bf05d1d5cbb2, disabling compactions & flushes 2023-02-16 17:01:06,625 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. 2023-02-16 17:01:06,625 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. 2023-02-16 17:01:06,625 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. after waiting 0 ms 2023-02-16 17:01:06,625 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. 2023-02-16 17:01:06,625 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. 2023-02-16 17:01:06,625 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 12266b3361a4f74b5085bf05d1d5cbb2: 2023-02-16 17:01:06,631 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:06,646 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566866634"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566866634"}]},"ts":"1676566866634"} 2023-02-16 17:01:06,706 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 17:01:06,708 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:06,712 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566866708"}]},"ts":"1676566866708"} 2023-02-16 17:01:06,716 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 17:01:06,721 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:06,723 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:06,723 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:06,723 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:06,725 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=12266b3361a4f74b5085bf05d1d5cbb2, ASSIGN}] 2023-02-16 17:01:06,728 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=12266b3361a4f74b5085bf05d1d5cbb2, ASSIGN 2023-02-16 17:01:06,729 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=12266b3361a4f74b5085bf05d1d5cbb2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34397,1676566863389; forceNewPlan=false, retain=false 2023-02-16 17:01:06,851 INFO [RS:0;jenkins-hbase4:34397] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34397%2C1676566863389, suffix=, logDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/WALs/jenkins-hbase4.apache.org,34397,1676566863389, archiveDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/oldWALs, maxLogs=32 2023-02-16 17:01:06,851 INFO [RS:1;jenkins-hbase4:41601] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41601%2C1676566863467, suffix=, logDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/WALs/jenkins-hbase4.apache.org,41601,1676566863467, archiveDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/oldWALs, maxLogs=32 2023-02-16 17:01:06,870 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42525,DS-fa0439dd-fa68-4a49-9f4d-21720e16a814,DISK] 2023-02-16 17:01:06,872 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46755,DS-66b66d56-f2d2-4d7c-bb06-d25318120509,DISK] 2023-02-16 17:01:06,872 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42525,DS-fa0439dd-fa68-4a49-9f4d-21720e16a814,DISK] 2023-02-16 17:01:06,873 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46755,DS-66b66d56-f2d2-4d7c-bb06-d25318120509,DISK] 2023-02-16 17:01:06,877 INFO [RS:1;jenkins-hbase4:41601] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/WALs/jenkins-hbase4.apache.org,41601,1676566863467/jenkins-hbase4.apache.org%2C41601%2C1676566863467.1676566866853 2023-02-16 17:01:06,878 INFO [RS:0;jenkins-hbase4:34397] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/WALs/jenkins-hbase4.apache.org,34397,1676566863389/jenkins-hbase4.apache.org%2C34397%2C1676566863389.1676566866853 2023-02-16 17:01:06,878 DEBUG [RS:1;jenkins-hbase4:41601] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42525,DS-fa0439dd-fa68-4a49-9f4d-21720e16a814,DISK], DatanodeInfoWithStorage[127.0.0.1:46755,DS-66b66d56-f2d2-4d7c-bb06-d25318120509,DISK]] 2023-02-16 17:01:06,878 DEBUG [RS:0;jenkins-hbase4:34397] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46755,DS-66b66d56-f2d2-4d7c-bb06-d25318120509,DISK], DatanodeInfoWithStorage[127.0.0.1:42525,DS-fa0439dd-fa68-4a49-9f4d-21720e16a814,DISK]] 2023-02-16 17:01:06,882 INFO [jenkins-hbase4:40495] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 17:01:06,883 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=12266b3361a4f74b5085bf05d1d5cbb2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:06,883 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566866882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566866882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566866882"}]},"ts":"1676566866882"} 2023-02-16 17:01:06,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 12266b3361a4f74b5085bf05d1d5cbb2, server=jenkins-hbase4.apache.org,34397,1676566863389}] 2023-02-16 17:01:07,050 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:07,050 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:07,054 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60516, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:07,060 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. 2023-02-16 17:01:07,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12266b3361a4f74b5085bf05d1d5cbb2, NAME => 'hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:07,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:07,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:07,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:07,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:07,064 INFO [StoreOpener-12266b3361a4f74b5085bf05d1d5cbb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:07,066 DEBUG [StoreOpener-12266b3361a4f74b5085bf05d1d5cbb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2/info 2023-02-16 17:01:07,066 DEBUG [StoreOpener-12266b3361a4f74b5085bf05d1d5cbb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2/info 2023-02-16 17:01:07,067 INFO [StoreOpener-12266b3361a4f74b5085bf05d1d5cbb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12266b3361a4f74b5085bf05d1d5cbb2 columnFamilyName info 2023-02-16 17:01:07,068 INFO [StoreOpener-12266b3361a4f74b5085bf05d1d5cbb2-1] regionserver.HStore(310): Store=12266b3361a4f74b5085bf05d1d5cbb2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:07,070 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:07,071 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:07,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:07,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:07,085 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 12266b3361a4f74b5085bf05d1d5cbb2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61641707, jitterRate=-0.08146698772907257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:07,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 12266b3361a4f74b5085bf05d1d5cbb2: 2023-02-16 17:01:07,087 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2., pid=6, masterSystemTime=1676566867049 2023-02-16 17:01:07,093 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. 2023-02-16 17:01:07,094 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. 2023-02-16 17:01:07,096 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=12266b3361a4f74b5085bf05d1d5cbb2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:07,096 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566867095"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566867095"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566867095"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566867095"}]},"ts":"1676566867095"} 2023-02-16 17:01:07,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 17:01:07,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 12266b3361a4f74b5085bf05d1d5cbb2, server=jenkins-hbase4.apache.org,34397,1676566863389 in 207 msec 2023-02-16 17:01:07,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 17:01:07,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=12266b3361a4f74b5085bf05d1d5cbb2, ASSIGN in 379 msec 2023-02-16 17:01:07,111 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:07,111 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566867111"}]},"ts":"1676566867111"} 2023-02-16 17:01:07,115 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 17:01:07,119 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:07,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 592 msec 2023-02-16 17:01:07,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 17:01:07,142 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:07,142 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:07,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:07,186 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60526, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:07,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 17:01:07,222 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:07,229 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2023-02-16 17:01:07,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 17:01:07,252 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:07,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-02-16 17:01:07,264 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 17:01:07,267 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 17:01:07,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.705sec 2023-02-16 17:01:07,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 17:01:07,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 17:01:07,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 17:01:07,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40495,1676566862134-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 17:01:07,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40495,1676566862134-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 17:01:07,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 17:01:07,331 DEBUG [Listener at localhost/43373] zookeeper.ReadOnlyZKClient(139): Connect 0x492f2b89 to 127.0.0.1:50419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:07,336 DEBUG [Listener at localhost/43373] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dd22fcc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:07,391 DEBUG [hconnection-0xbaaca54-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:07,404 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58450, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:07,415 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40495,1676566862134 2023-02-16 17:01:07,416 DEBUG [Listener at localhost/43373] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 17:01:07,425 DEBUG [Listener at localhost/43373] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 17:01:07,428 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46500, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 17:01:07,432 INFO [Listener at localhost/43373] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 17:01:07,437 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 17:01:07,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 17:01:07,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:46500 deadline: 1676566927436, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 17:01:07,439 INFO [Listener at localhost/43373] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 17:01:07,453 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:07,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 17:01:07,458 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:07,460 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:07,465 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 17:01:07,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:07,485 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:07,486 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:07,486 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:07,487 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:07,487 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:07,487 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:07,487 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817 2023-02-16 17:01:07,487 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc empty. 2023-02-16 17:01:07,486 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:07,487 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec empty. 2023-02-16 17:01:07,488 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e empty. 2023-02-16 17:01:07,488 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036 empty. 2023-02-16 17:01:07,488 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed empty. 2023-02-16 17:01:07,490 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991 empty. 2023-02-16 17:01:07,490 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:07,491 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817 empty. 2023-02-16 17:01:07,491 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198 empty. 2023-02-16 17:01:07,491 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:07,491 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:07,491 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:07,491 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:07,491 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:07,492 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817 2023-02-16 17:01:07,492 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4 empty. 2023-02-16 17:01:07,492 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:07,492 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0 empty. 2023-02-16 17:01:07,493 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:07,493 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:07,493 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:07,493 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:07,493 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 17:01:07,530 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:07,532 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 24d6989912aa4c5c32a50fd8baf30fcc, NAME => 'testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp 2023-02-16 17:01:07,537 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 362aaa800a6f24c8e691ce188edeecec, NAME => 'testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp 2023-02-16 17:01:07,545 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 06fd504538972f7449bc0b3227fa4198, NAME => 'testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp 2023-02-16 17:01:07,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:07,599 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:07,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:07,602 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 362aaa800a6f24c8e691ce188edeecec, disabling compactions & flushes 2023-02-16 17:01:07,602 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 24d6989912aa4c5c32a50fd8baf30fcc, disabling compactions & flushes 2023-02-16 17:01:07,602 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:07,602 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:07,602 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. after waiting 0 ms 2023-02-16 17:01:07,602 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:07,603 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:07,603 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:07,603 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:07,603 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. after waiting 0 ms 2023-02-16 17:01:07,603 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 24d6989912aa4c5c32a50fd8baf30fcc: 2023-02-16 17:01:07,603 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:07,603 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:07,603 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 362aaa800a6f24c8e691ce188edeecec: 2023-02-16 17:01:07,604 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3387c5fcea518e8693a59cfd54f1842e, NAME => 'testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp 2023-02-16 17:01:07,604 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3a316f18bc36030ad711981973302817, NAME => 'testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp 2023-02-16 17:01:07,608 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:07,610 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 06fd504538972f7449bc0b3227fa4198, disabling compactions & flushes 2023-02-16 17:01:07,610 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:07,610 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:07,610 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. after waiting 0 ms 2023-02-16 17:01:07,610 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:07,610 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:07,610 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 06fd504538972f7449bc0b3227fa4198: 2023-02-16 17:01:07,611 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => d0b64600fb3c2bef9100c7e97ba82991, NAME => 'testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp 2023-02-16 17:01:07,654 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:07,655 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 3387c5fcea518e8693a59cfd54f1842e, disabling compactions & flushes 2023-02-16 17:01:07,658 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:07,658 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:07,658 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. after waiting 0 ms 2023-02-16 17:01:07,659 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:07,659 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:07,659 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 3387c5fcea518e8693a59cfd54f1842e: 2023-02-16 17:01:07,659 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => dba382119e74f3337a2e4dde935e21ed, NAME => 'testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp 2023-02-16 17:01:07,660 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:07,660 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:07,661 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing d0b64600fb3c2bef9100c7e97ba82991, disabling compactions & flushes 2023-02-16 17:01:07,661 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 3a316f18bc36030ad711981973302817, disabling compactions & flushes 2023-02-16 17:01:07,661 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:07,661 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:07,661 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:07,661 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:07,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. after waiting 0 ms 2023-02-16 17:01:07,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. after waiting 0 ms 2023-02-16 17:01:07,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:07,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:07,662 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:07,662 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:07,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for d0b64600fb3c2bef9100c7e97ba82991: 2023-02-16 17:01:07,662 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 3a316f18bc36030ad711981973302817: 2023-02-16 17:01:07,663 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8adbcab08ea9bcb78f6d7bee68684036, NAME => 'testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp 2023-02-16 17:01:07,663 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => dea97ec90688c064e4a226d52af25da0, NAME => 'testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp 2023-02-16 17:01:07,688 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:07,690 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing dba382119e74f3337a2e4dde935e21ed, disabling compactions & flushes 2023-02-16 17:01:07,690 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:07,690 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:07,690 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. after waiting 0 ms 2023-02-16 17:01:07,690 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:07,690 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:07,690 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for dba382119e74f3337a2e4dde935e21ed: 2023-02-16 17:01:07,691 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e1a7443ba00bdedeceff74e5c3ff1dc4, NAME => 'testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp 2023-02-16 17:01:07,692 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:07,692 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing dea97ec90688c064e4a226d52af25da0, disabling compactions & flushes 2023-02-16 17:01:07,692 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:07,692 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:07,692 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. after waiting 0 ms 2023-02-16 17:01:07,692 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:07,692 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:07,693 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for dea97ec90688c064e4a226d52af25da0: 2023-02-16 17:01:07,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:07,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e1a7443ba00bdedeceff74e5c3ff1dc4, disabling compactions & flushes 2023-02-16 17:01:07,712 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:07,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:07,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. after waiting 0 ms 2023-02-16 17:01:07,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:07,712 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:07,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e1a7443ba00bdedeceff74e5c3ff1dc4: 2023-02-16 17:01:07,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:08,093 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:08,094 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 8adbcab08ea9bcb78f6d7bee68684036, disabling compactions & flushes 2023-02-16 17:01:08,094 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:08,094 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:08,094 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. after waiting 0 ms 2023-02-16 17:01:08,094 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:08,094 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:08,094 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 8adbcab08ea9bcb78f6d7bee68684036: 2023-02-16 17:01:08,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:08,100 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:08,102 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566868101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566868101"}]},"ts":"1676566868101"} 2023-02-16 17:01:08,102 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566868101"}]},"ts":"1676566868101"} 2023-02-16 17:01:08,102 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566868101"}]},"ts":"1676566868101"} 2023-02-16 17:01:08,102 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566868101"}]},"ts":"1676566868101"} 2023-02-16 17:01:08,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566868101"}]},"ts":"1676566868101"} 2023-02-16 17:01:08,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676566867448.3a316f18bc36030ad711981973302817.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566868101"}]},"ts":"1676566868101"} 2023-02-16 17:01:08,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566868101"}]},"ts":"1676566868101"} 2023-02-16 17:01:08,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566868101"}]},"ts":"1676566868101"} 2023-02-16 17:01:08,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566868101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566868101"}]},"ts":"1676566868101"} 2023-02-16 17:01:08,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566868101"}]},"ts":"1676566868101"} 2023-02-16 17:01:08,154 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 17:01:08,156 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:08,156 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566868156"}]},"ts":"1676566868156"} 2023-02-16 17:01:08,158 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 17:01:08,163 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:08,175 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:08,175 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:08,175 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:08,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=24d6989912aa4c5c32a50fd8baf30fcc, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=362aaa800a6f24c8e691ce188edeecec, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=06fd504538972f7449bc0b3227fa4198, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3387c5fcea518e8693a59cfd54f1842e, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3a316f18bc36030ad711981973302817, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d0b64600fb3c2bef9100c7e97ba82991, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dba382119e74f3337a2e4dde935e21ed, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8adbcab08ea9bcb78f6d7bee68684036, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dea97ec90688c064e4a226d52af25da0, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e1a7443ba00bdedeceff74e5c3ff1dc4, ASSIGN}] 2023-02-16 17:01:08,180 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=24d6989912aa4c5c32a50fd8baf30fcc, ASSIGN 2023-02-16 17:01:08,180 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=06fd504538972f7449bc0b3227fa4198, ASSIGN 2023-02-16 17:01:08,181 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3387c5fcea518e8693a59cfd54f1842e, ASSIGN 2023-02-16 17:01:08,181 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=362aaa800a6f24c8e691ce188edeecec, ASSIGN 2023-02-16 17:01:08,182 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=24d6989912aa4c5c32a50fd8baf30fcc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41601,1676566863467; forceNewPlan=false, retain=false 2023-02-16 17:01:08,183 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=06fd504538972f7449bc0b3227fa4198, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41601,1676566863467; forceNewPlan=false, retain=false 2023-02-16 17:01:08,183 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=362aaa800a6f24c8e691ce188edeecec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34397,1676566863389; forceNewPlan=false, retain=false 2023-02-16 17:01:08,183 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3387c5fcea518e8693a59cfd54f1842e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34397,1676566863389; forceNewPlan=false, retain=false 2023-02-16 17:01:08,184 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e1a7443ba00bdedeceff74e5c3ff1dc4, ASSIGN 2023-02-16 17:01:08,184 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8adbcab08ea9bcb78f6d7bee68684036, ASSIGN 2023-02-16 17:01:08,185 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d0b64600fb3c2bef9100c7e97ba82991, ASSIGN 2023-02-16 17:01:08,185 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dea97ec90688c064e4a226d52af25da0, ASSIGN 2023-02-16 17:01:08,185 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dba382119e74f3337a2e4dde935e21ed, ASSIGN 2023-02-16 17:01:08,186 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e1a7443ba00bdedeceff74e5c3ff1dc4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41601,1676566863467; forceNewPlan=false, retain=false 2023-02-16 17:01:08,186 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8adbcab08ea9bcb78f6d7bee68684036, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34397,1676566863389; forceNewPlan=false, retain=false 2023-02-16 17:01:08,186 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d0b64600fb3c2bef9100c7e97ba82991, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41601,1676566863467; forceNewPlan=false, retain=false 2023-02-16 17:01:08,186 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dba382119e74f3337a2e4dde935e21ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41601,1676566863467; forceNewPlan=false, retain=false 2023-02-16 17:01:08,186 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dea97ec90688c064e4a226d52af25da0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34397,1676566863389; forceNewPlan=false, retain=false 2023-02-16 17:01:08,188 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3a316f18bc36030ad711981973302817, ASSIGN 2023-02-16 17:01:08,189 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3a316f18bc36030ad711981973302817, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34397,1676566863389; forceNewPlan=false, retain=false 2023-02-16 17:01:08,333 INFO [jenkins-hbase4:40495] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 17:01:08,337 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=06fd504538972f7449bc0b3227fa4198, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:08,337 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e1a7443ba00bdedeceff74e5c3ff1dc4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:08,337 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d0b64600fb3c2bef9100c7e97ba82991, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:08,337 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=24d6989912aa4c5c32a50fd8baf30fcc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:08,337 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566868337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566868337"}]},"ts":"1676566868337"} 2023-02-16 17:01:08,337 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566868337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566868337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566868337"}]},"ts":"1676566868337"} 2023-02-16 17:01:08,337 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566868337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566868337"}]},"ts":"1676566868337"} 2023-02-16 17:01:08,338 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566868337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566868337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566868337"}]},"ts":"1676566868337"} 2023-02-16 17:01:08,337 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=dba382119e74f3337a2e4dde935e21ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:08,338 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566868337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566868337"}]},"ts":"1676566868337"} 2023-02-16 17:01:08,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure e1a7443ba00bdedeceff74e5c3ff1dc4, server=jenkins-hbase4.apache.org,41601,1676566863467}] 2023-02-16 17:01:08,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure d0b64600fb3c2bef9100c7e97ba82991, server=jenkins-hbase4.apache.org,41601,1676566863467}] 2023-02-16 17:01:08,346 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3387c5fcea518e8693a59cfd54f1842e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:08,346 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566868346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566868346"}]},"ts":"1676566868346"} 2023-02-16 17:01:08,347 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3a316f18bc36030ad711981973302817, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:08,348 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676566867448.3a316f18bc36030ad711981973302817.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566868347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566868347"}]},"ts":"1676566868347"} 2023-02-16 17:01:08,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=13, state=RUNNABLE; OpenRegionProcedure 06fd504538972f7449bc0b3227fa4198, server=jenkins-hbase4.apache.org,41601,1676566863467}] 2023-02-16 17:01:08,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure 24d6989912aa4c5c32a50fd8baf30fcc, server=jenkins-hbase4.apache.org,41601,1676566863467}] 2023-02-16 17:01:08,352 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure dba382119e74f3337a2e4dde935e21ed, server=jenkins-hbase4.apache.org,41601,1676566863467}] 2023-02-16 17:01:08,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=14, state=RUNNABLE; OpenRegionProcedure 3387c5fcea518e8693a59cfd54f1842e, server=jenkins-hbase4.apache.org,34397,1676566863389}] 2023-02-16 17:01:08,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=15, state=RUNNABLE; OpenRegionProcedure 3a316f18bc36030ad711981973302817, server=jenkins-hbase4.apache.org,34397,1676566863389}] 2023-02-16 17:01:08,357 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=362aaa800a6f24c8e691ce188edeecec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:08,357 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566868357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566868357"}]},"ts":"1676566868357"} 2023-02-16 17:01:08,358 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=dea97ec90688c064e4a226d52af25da0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:08,359 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566868358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566868358"}]},"ts":"1676566868358"} 2023-02-16 17:01:08,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure 362aaa800a6f24c8e691ce188edeecec, server=jenkins-hbase4.apache.org,34397,1676566863389}] 2023-02-16 17:01:08,362 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=8adbcab08ea9bcb78f6d7bee68684036, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:08,362 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868362"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566868362"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566868362"}]},"ts":"1676566868362"} 2023-02-16 17:01:08,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=19, state=RUNNABLE; OpenRegionProcedure dea97ec90688c064e4a226d52af25da0, server=jenkins-hbase4.apache.org,34397,1676566863389}] 2023-02-16 17:01:08,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=18, state=RUNNABLE; OpenRegionProcedure 8adbcab08ea9bcb78f6d7bee68684036, server=jenkins-hbase4.apache.org,34397,1676566863389}] 2023-02-16 17:01:08,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:08,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dba382119e74f3337a2e4dde935e21ed, NAME => 'testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 17:01:08,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:08,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:08,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:08,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:08,505 INFO [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:08,507 DEBUG [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1 2023-02-16 17:01:08,508 DEBUG [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1 2023-02-16 17:01:08,508 INFO [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dba382119e74f3337a2e4dde935e21ed columnFamilyName f1 2023-02-16 17:01:08,509 INFO [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] regionserver.HStore(310): Store=dba382119e74f3337a2e4dde935e21ed/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,509 INFO [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:08,513 DEBUG [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2 2023-02-16 17:01:08,513 DEBUG [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2 2023-02-16 17:01:08,514 INFO [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dba382119e74f3337a2e4dde935e21ed columnFamilyName f2 2023-02-16 17:01:08,514 INFO [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] regionserver.HStore(310): Store=dba382119e74f3337a2e4dde935e21ed/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:08,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:08,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:08,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 362aaa800a6f24c8e691ce188edeecec, NAME => 'testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 17:01:08,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:08,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:08,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:08,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:08,521 INFO [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:08,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:08,524 DEBUG [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1 2023-02-16 17:01:08,524 DEBUG [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1 2023-02-16 17:01:08,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:08,524 INFO [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 362aaa800a6f24c8e691ce188edeecec columnFamilyName f1 2023-02-16 17:01:08,525 INFO [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] regionserver.HStore(310): Store=362aaa800a6f24c8e691ce188edeecec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,525 INFO [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:08,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:08,528 DEBUG [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2 2023-02-16 17:01:08,528 DEBUG [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2 2023-02-16 17:01:08,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dba382119e74f3337a2e4dde935e21ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72293255, jitterRate=0.07725344598293304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:08,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dba382119e74f3337a2e4dde935e21ed: 2023-02-16 17:01:08,529 INFO [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 362aaa800a6f24c8e691ce188edeecec columnFamilyName f2 2023-02-16 17:01:08,530 INFO [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] regionserver.HStore(310): Store=362aaa800a6f24c8e691ce188edeecec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed., pid=25, masterSystemTime=1676566868495 2023-02-16 17:01:08,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:08,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:08,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:08,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:08,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:08,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 24d6989912aa4c5c32a50fd8baf30fcc, NAME => 'testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 17:01:08,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:08,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:08,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:08,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:08,537 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=dba382119e74f3337a2e4dde935e21ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:08,537 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868537"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566868537"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566868537"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566868537"}]},"ts":"1676566868537"} 2023-02-16 17:01:08,539 INFO [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:08,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:08,542 DEBUG [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/f1 2023-02-16 17:01:08,542 DEBUG [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/f1 2023-02-16 17:01:08,542 INFO [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24d6989912aa4c5c32a50fd8baf30fcc columnFamilyName f1 2023-02-16 17:01:08,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:08,544 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-16 17:01:08,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure dba382119e74f3337a2e4dde935e21ed, server=jenkins-hbase4.apache.org,41601,1676566863467 in 189 msec 2023-02-16 17:01:08,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dba382119e74f3337a2e4dde935e21ed, ASSIGN in 369 msec 2023-02-16 17:01:08,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:08,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 362aaa800a6f24c8e691ce188edeecec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63267531, jitterRate=-0.0572403222322464}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:08,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 362aaa800a6f24c8e691ce188edeecec: 2023-02-16 17:01:08,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec., pid=28, masterSystemTime=1676566868510 2023-02-16 17:01:08,550 INFO [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] regionserver.HStore(310): Store=24d6989912aa4c5c32a50fd8baf30fcc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,550 INFO [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:08,552 DEBUG [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/f2 2023-02-16 17:01:08,553 DEBUG [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/f2 2023-02-16 17:01:08,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:08,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:08,553 INFO [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24d6989912aa4c5c32a50fd8baf30fcc columnFamilyName f2 2023-02-16 17:01:08,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:08,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8adbcab08ea9bcb78f6d7bee68684036, NAME => 'testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 17:01:08,553 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=362aaa800a6f24c8e691ce188edeecec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:08,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:08,554 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868553"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566868553"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566868553"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566868553"}]},"ts":"1676566868553"} 2023-02-16 17:01:08,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:08,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:08,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:08,554 INFO [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] regionserver.HStore(310): Store=24d6989912aa4c5c32a50fd8baf30fcc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,564 INFO [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:08,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-16 17:01:08,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure 362aaa800a6f24c8e691ce188edeecec, server=jenkins-hbase4.apache.org,34397,1676566863389 in 197 msec 2023-02-16 17:01:08,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:08,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:08,566 DEBUG [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1 2023-02-16 17:01:08,567 DEBUG [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1 2023-02-16 17:01:08,567 INFO [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8adbcab08ea9bcb78f6d7bee68684036 columnFamilyName f1 2023-02-16 17:01:08,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=362aaa800a6f24c8e691ce188edeecec, ASSIGN in 389 msec 2023-02-16 17:01:08,568 INFO [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] regionserver.HStore(310): Store=8adbcab08ea9bcb78f6d7bee68684036/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,569 INFO [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:08,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:08,571 DEBUG [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2 2023-02-16 17:01:08,571 DEBUG [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2 2023-02-16 17:01:08,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:08,573 INFO [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8adbcab08ea9bcb78f6d7bee68684036 columnFamilyName f2 2023-02-16 17:01:08,574 INFO [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] regionserver.HStore(310): Store=8adbcab08ea9bcb78f6d7bee68684036/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:08,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:08,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:08,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 24d6989912aa4c5c32a50fd8baf30fcc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73476702, jitterRate=0.09488818049430847}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:08,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 24d6989912aa4c5c32a50fd8baf30fcc: 2023-02-16 17:01:08,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc., pid=24, masterSystemTime=1676566868495 2023-02-16 17:01:08,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:08,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:08,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:08,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:08,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d0b64600fb3c2bef9100c7e97ba82991, NAME => 'testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 17:01:08,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:08,588 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=24d6989912aa4c5c32a50fd8baf30fcc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:08,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:08,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:08,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:08,589 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566868588"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566868588"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566868588"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566868588"}]},"ts":"1676566868588"} 2023-02-16 17:01:08,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:08,591 INFO [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:08,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:08,594 DEBUG [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1 2023-02-16 17:01:08,594 DEBUG [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1 2023-02-16 17:01:08,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8adbcab08ea9bcb78f6d7bee68684036; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72108046, jitterRate=0.07449361681938171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:08,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8adbcab08ea9bcb78f6d7bee68684036: 2023-02-16 17:01:08,595 INFO [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0b64600fb3c2bef9100c7e97ba82991 columnFamilyName f1 2023-02-16 17:01:08,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-16 17:01:08,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure 24d6989912aa4c5c32a50fd8baf30fcc, server=jenkins-hbase4.apache.org,41601,1676566863467 in 242 msec 2023-02-16 17:01:08,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036., pid=30, masterSystemTime=1676566868510 2023-02-16 17:01:08,599 INFO [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] regionserver.HStore(310): Store=d0b64600fb3c2bef9100c7e97ba82991/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,599 INFO [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:08,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:08,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=24d6989912aa4c5c32a50fd8baf30fcc, ASSIGN in 420 msec 2023-02-16 17:01:08,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:08,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:08,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:08,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3a316f18bc36030ad711981973302817, NAME => 'testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 17:01:08,602 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=8adbcab08ea9bcb78f6d7bee68684036, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:08,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3a316f18bc36030ad711981973302817 2023-02-16 17:01:08,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:08,602 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868601"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566868601"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566868601"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566868601"}]},"ts":"1676566868601"} 2023-02-16 17:01:08,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3a316f18bc36030ad711981973302817 2023-02-16 17:01:08,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3a316f18bc36030ad711981973302817 2023-02-16 17:01:08,603 DEBUG [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2 2023-02-16 17:01:08,603 DEBUG [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2 2023-02-16 17:01:08,604 INFO [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0b64600fb3c2bef9100c7e97ba82991 columnFamilyName f2 2023-02-16 17:01:08,605 INFO [StoreOpener-3a316f18bc36030ad711981973302817-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3a316f18bc36030ad711981973302817 2023-02-16 17:01:08,605 INFO [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] regionserver.HStore(310): Store=d0b64600fb3c2bef9100c7e97ba82991/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:08,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:08,609 DEBUG [StoreOpener-3a316f18bc36030ad711981973302817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1 2023-02-16 17:01:08,609 DEBUG [StoreOpener-3a316f18bc36030ad711981973302817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1 2023-02-16 17:01:08,609 INFO [StoreOpener-3a316f18bc36030ad711981973302817-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a316f18bc36030ad711981973302817 columnFamilyName f1 2023-02-16 17:01:08,610 INFO [StoreOpener-3a316f18bc36030ad711981973302817-1] regionserver.HStore(310): Store=3a316f18bc36030ad711981973302817/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=18 2023-02-16 17:01:08,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=18, state=SUCCESS; OpenRegionProcedure 8adbcab08ea9bcb78f6d7bee68684036, server=jenkins-hbase4.apache.org,34397,1676566863389 in 233 msec 2023-02-16 17:01:08,611 INFO [StoreOpener-3a316f18bc36030ad711981973302817-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3a316f18bc36030ad711981973302817 2023-02-16 17:01:08,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:08,614 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8adbcab08ea9bcb78f6d7bee68684036, ASSIGN in 435 msec 2023-02-16 17:01:08,614 DEBUG [StoreOpener-3a316f18bc36030ad711981973302817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2 2023-02-16 17:01:08,614 DEBUG [StoreOpener-3a316f18bc36030ad711981973302817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2 2023-02-16 17:01:08,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:08,615 INFO [StoreOpener-3a316f18bc36030ad711981973302817-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a316f18bc36030ad711981973302817 columnFamilyName f2 2023-02-16 17:01:08,616 INFO [StoreOpener-3a316f18bc36030ad711981973302817-1] regionserver.HStore(310): Store=3a316f18bc36030ad711981973302817/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817 2023-02-16 17:01:08,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817 2023-02-16 17:01:08,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:08,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:08,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3a316f18bc36030ad711981973302817 2023-02-16 17:01:08,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:08,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3a316f18bc36030ad711981973302817; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62773022, jitterRate=-0.06460908055305481}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:08,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3a316f18bc36030ad711981973302817: 2023-02-16 17:01:08,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817., pid=27, masterSystemTime=1676566868510 2023-02-16 17:01:08,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d0b64600fb3c2bef9100c7e97ba82991; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65904083, jitterRate=-0.017952635884284973}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:08,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d0b64600fb3c2bef9100c7e97ba82991: 2023-02-16 17:01:08,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991., pid=22, masterSystemTime=1676566868495 2023-02-16 17:01:08,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:08,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:08,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:08,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3387c5fcea518e8693a59cfd54f1842e, NAME => 'testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 17:01:08,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:08,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:08,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:08,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:08,636 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3a316f18bc36030ad711981973302817, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:08,636 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676566867448.3a316f18bc36030ad711981973302817.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868635"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566868635"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566868635"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566868635"}]},"ts":"1676566868635"} 2023-02-16 17:01:08,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:08,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:08,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:08,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 06fd504538972f7449bc0b3227fa4198, NAME => 'testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 17:01:08,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:08,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:08,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:08,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:08,638 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d0b64600fb3c2bef9100c7e97ba82991, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:08,639 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868637"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566868637"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566868637"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566868637"}]},"ts":"1676566868637"} 2023-02-16 17:01:08,639 INFO [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:08,640 INFO [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:08,643 DEBUG [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1 2023-02-16 17:01:08,643 DEBUG [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1 2023-02-16 17:01:08,644 INFO [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3387c5fcea518e8693a59cfd54f1842e columnFamilyName f1 2023-02-16 17:01:08,645 INFO [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] regionserver.HStore(310): Store=3387c5fcea518e8693a59cfd54f1842e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,645 DEBUG [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1 2023-02-16 17:01:08,645 INFO [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:08,645 DEBUG [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1 2023-02-16 17:01:08,646 INFO [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06fd504538972f7449bc0b3227fa4198 columnFamilyName f1 2023-02-16 17:01:08,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=15 2023-02-16 17:01:08,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=15, state=SUCCESS; OpenRegionProcedure 3a316f18bc36030ad711981973302817, server=jenkins-hbase4.apache.org,34397,1676566863389 in 284 msec 2023-02-16 17:01:08,647 INFO [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] regionserver.HStore(310): Store=06fd504538972f7449bc0b3227fa4198/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,647 INFO [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:08,649 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-16 17:01:08,649 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure d0b64600fb3c2bef9100c7e97ba82991, server=jenkins-hbase4.apache.org,41601,1676566863467 in 302 msec 2023-02-16 17:01:08,649 DEBUG [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2 2023-02-16 17:01:08,649 DEBUG [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2 2023-02-16 17:01:08,650 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3a316f18bc36030ad711981973302817, ASSIGN in 470 msec 2023-02-16 17:01:08,650 INFO [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06fd504538972f7449bc0b3227fa4198 columnFamilyName f2 2023-02-16 17:01:08,650 DEBUG [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2 2023-02-16 17:01:08,651 DEBUG [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2 2023-02-16 17:01:08,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d0b64600fb3c2bef9100c7e97ba82991, ASSIGN in 473 msec 2023-02-16 17:01:08,651 INFO [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3387c5fcea518e8693a59cfd54f1842e columnFamilyName f2 2023-02-16 17:01:08,651 INFO [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] regionserver.HStore(310): Store=06fd504538972f7449bc0b3227fa4198/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,653 INFO [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] regionserver.HStore(310): Store=3387c5fcea518e8693a59cfd54f1842e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:08,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:08,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:08,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:08,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:08,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:08,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:08,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:08,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:08,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:08,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 06fd504538972f7449bc0b3227fa4198; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64628355, jitterRate=-0.036962464451789856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:08,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 06fd504538972f7449bc0b3227fa4198: 2023-02-16 17:01:08,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3387c5fcea518e8693a59cfd54f1842e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66945619, jitterRate=-0.0024325400590896606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:08,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3387c5fcea518e8693a59cfd54f1842e: 2023-02-16 17:01:08,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198., pid=23, masterSystemTime=1676566868495 2023-02-16 17:01:08,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e., pid=26, masterSystemTime=1676566868510 2023-02-16 17:01:08,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:08,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:08,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:08,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e1a7443ba00bdedeceff74e5c3ff1dc4, NAME => 'testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 17:01:08,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:08,677 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=06fd504538972f7449bc0b3227fa4198, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:08,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:08,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:08,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:08,677 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566868677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566868677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566868677"}]},"ts":"1676566868677"} 2023-02-16 17:01:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:08,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:08,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dea97ec90688c064e4a226d52af25da0, NAME => 'testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 17:01:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:08,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:08,680 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3387c5fcea518e8693a59cfd54f1842e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:08,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868679"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566868679"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566868679"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566868679"}]},"ts":"1676566868679"} 2023-02-16 17:01:08,682 INFO [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:08,683 INFO [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:08,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=13 2023-02-16 17:01:08,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=13, state=SUCCESS; OpenRegionProcedure 06fd504538972f7449bc0b3227fa4198, server=jenkins-hbase4.apache.org,41601,1676566863467 in 331 msec 2023-02-16 17:01:08,685 DEBUG [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/f1 2023-02-16 17:01:08,685 DEBUG [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/f1 2023-02-16 17:01:08,685 INFO [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1a7443ba00bdedeceff74e5c3ff1dc4 columnFamilyName f1 2023-02-16 17:01:08,686 DEBUG [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1 2023-02-16 17:01:08,686 DEBUG [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1 2023-02-16 17:01:08,686 INFO [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] regionserver.HStore(310): Store=e1a7443ba00bdedeceff74e5c3ff1dc4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,687 INFO [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:08,686 INFO [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dea97ec90688c064e4a226d52af25da0 columnFamilyName f1 2023-02-16 17:01:08,687 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=14 2023-02-16 17:01:08,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=14, state=SUCCESS; OpenRegionProcedure 3387c5fcea518e8693a59cfd54f1842e, server=jenkins-hbase4.apache.org,34397,1676566863389 in 327 msec 2023-02-16 17:01:08,688 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=06fd504538972f7449bc0b3227fa4198, ASSIGN in 509 msec 2023-02-16 17:01:08,688 INFO [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] regionserver.HStore(310): Store=dea97ec90688c064e4a226d52af25da0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,688 INFO [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:08,689 DEBUG [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/f2 2023-02-16 17:01:08,689 DEBUG [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/f2 2023-02-16 17:01:08,689 INFO [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1a7443ba00bdedeceff74e5c3ff1dc4 columnFamilyName f2 2023-02-16 17:01:08,689 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3387c5fcea518e8693a59cfd54f1842e, ASSIGN in 511 msec 2023-02-16 17:01:08,690 INFO [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] regionserver.HStore(310): Store=e1a7443ba00bdedeceff74e5c3ff1dc4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,692 DEBUG [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2 2023-02-16 17:01:08,692 DEBUG [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2 2023-02-16 17:01:08,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:08,692 INFO [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dea97ec90688c064e4a226d52af25da0 columnFamilyName f2 2023-02-16 17:01:08,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:08,693 INFO [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] regionserver.HStore(310): Store=dea97ec90688c064e4a226d52af25da0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:08,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:08,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:08,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:08,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:08,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:08,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:08,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:08,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e1a7443ba00bdedeceff74e5c3ff1dc4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68031490, jitterRate=0.013748198747634888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:08,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e1a7443ba00bdedeceff74e5c3ff1dc4: 2023-02-16 17:01:08,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:08,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4., pid=21, masterSystemTime=1676566868495 2023-02-16 17:01:08,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dea97ec90688c064e4a226d52af25da0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68972083, jitterRate=0.027764126658439636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:08,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dea97ec90688c064e4a226d52af25da0: 2023-02-16 17:01:08,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0., pid=29, masterSystemTime=1676566868510 2023-02-16 17:01:08,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:08,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:08,709 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e1a7443ba00bdedeceff74e5c3ff1dc4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:08,709 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566868709"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566868709"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566868709"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566868709"}]},"ts":"1676566868709"} 2023-02-16 17:01:08,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:08,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:08,710 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=dea97ec90688c064e4a226d52af25da0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:08,710 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566868710"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566868710"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566868710"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566868710"}]},"ts":"1676566868710"} 2023-02-16 17:01:08,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-16 17:01:08,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure e1a7443ba00bdedeceff74e5c3ff1dc4, server=jenkins-hbase4.apache.org,41601,1676566863467 in 371 msec 2023-02-16 17:01:08,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=19 2023-02-16 17:01:08,719 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e1a7443ba00bdedeceff74e5c3ff1dc4, ASSIGN in 539 msec 2023-02-16 17:01:08,719 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=19, state=SUCCESS; OpenRegionProcedure dea97ec90688c064e4a226d52af25da0, server=jenkins-hbase4.apache.org,34397,1676566863389 in 344 msec 2023-02-16 17:01:08,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-16 17:01:08,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dea97ec90688c064e4a226d52af25da0, ASSIGN in 543 msec 2023-02-16 17:01:08,723 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:08,723 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566868723"}]},"ts":"1676566868723"} 2023-02-16 17:01:08,725 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 17:01:08,728 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:08,732 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.2760 sec 2023-02-16 17:01:09,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:09,602 INFO [Listener at localhost/43373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 17:01:09,602 DEBUG [Listener at localhost/43373] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 17:01:09,605 INFO [Listener at localhost/43373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:09,615 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 17:01:09,616 INFO [Listener at localhost/43373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:09,616 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 17:01:09,617 INFO [Listener at localhost/43373] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 17:01:09,773 DEBUG [hconnection-0xbaaca54-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:09,839 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60528, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:09,848 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41601] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:09,869 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34397] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:10,138 INFO [Listener at localhost/43373] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 17:01:10,143 INFO [Listener at localhost/43373] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 17:01:10,157 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 17:01:10,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676566870157 (current time:1676566870157). 2023-02-16 17:01:10,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 17:01:10,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] zookeeper.ReadOnlyZKClient(139): Connect 0x4ea4e362 to 127.0.0.1:50419 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:10,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5518e667, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:10,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:10,170 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58458, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:10,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ea4e362 to 127.0.0.1:50419 2023-02-16 17:01:10,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:10,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 17:01:10,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 17:01:10,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 17:01:10,203 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 17:01:10,205 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676567470204 2023-02-16 17:01:10,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 17:01:10,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 17:01:10,210 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 17:01:10,214 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:10,214 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 17:01:10,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 17:01:10,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 19 msec 2023-02-16 17:01:10,216 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 17:01:10,217 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676567470217 2023-02-16 17:01:10,314 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:10,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 17:01:10,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:10,319 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 17:01:10,520 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:10,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 17:01:10,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:10,522 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 17:01:10,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-16 17:01:10,646 INFO [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-16 17:01:10,646 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:10,646 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-16 17:01:10,646 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 17:01:10,647 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:10,647 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 17:01:10,648 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:10,648 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:10,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:10,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:10,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:10,648 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:10,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:10,649 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:10,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 17:01:10,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 17:01:10,649 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:10,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:10,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:10,650 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:10,650 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:10,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-16 17:01:10,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-16 17:01:10,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 17:01:10,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 17:01:10,651 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 17:01:10,651 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 17:01:10,654 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-16 17:01:10,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-16 17:01:10,656 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-16 17:01:10,656 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:10,656 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-16 17:01:10,657 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 17:01:10,657 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-16 17:01:10,657 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:10,657 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41601,1676566863467' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-16 17:01:10,657 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 17:01:10,657 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-16 17:01:10,657 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34397,1676566863389' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-16 17:01:10,659 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:10,659 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:10,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:10,660 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:10,659 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:10,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:10,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:10,660 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:10,660 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:10,660 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:10,660 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:10,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:10,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:10,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 17:01:10,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:10,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:10,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:10,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41601,1676566863467' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-16 17:01:10,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22e95c45[Count = 1] remaining members to acquire global barrier 2023-02-16 17:01:10,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:10,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:10,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:10,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:10,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:10,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 17:01:10,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:10,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:10,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:10,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34397,1676566863389' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-16 17:01:10,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22e95c45[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:10,665 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 17:01:10,665 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:10,667 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:10,667 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:10,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:10,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:10,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:10,668 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:10,668 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 17:01:10,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:10,668 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 17:01:10,668 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:10,668 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:10,669 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:10,669 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:10,669 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:10,669 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. started... 2023-02-16 17:01:10,669 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:10,670 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. started... 2023-02-16 17:01:10,669 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. started... 2023-02-16 17:01:10,670 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 17:01:10,669 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. started... 2023-02-16 17:01:10,670 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 17:01:10,670 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:10,670 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 17:01:10,670 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:10,670 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. started... 2023-02-16 17:01:10,670 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 17:01:10,670 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. started... 2023-02-16 17:01:10,672 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 362aaa800a6f24c8e691ce188edeecec 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 17:01:10,672 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 06fd504538972f7449bc0b3227fa4198 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:10,672 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] regionserver.HRegion(2744): Flushing dea97ec90688c064e4a226d52af25da0 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 17:01:10,674 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 24d6989912aa4c5c32a50fd8baf30fcc: 2023-02-16 17:01:10,672 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3387c5fcea518e8693a59cfd54f1842e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:10,674 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:10,674 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e1a7443ba00bdedeceff74e5c3ff1dc4: 2023-02-16 17:01:10,675 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:10,679 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:10,679 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:10,684 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 17:01:10,684 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 17:01:10,684 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 17:01:10,685 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 17:01:10,728 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. completed. 2023-02-16 17:01:10,728 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:10,730 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 17:01:10,730 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:10,730 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. started... 2023-02-16 17:01:10,731 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. completed. 2023-02-16 17:01:10,731 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] regionserver.HRegion(2744): Flushing dba382119e74f3337a2e4dde935e21ed 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:10,731 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:10,731 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:10,731 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 17:01:10,731 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. started... 2023-02-16 17:01:10,732 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d0b64600fb3c2bef9100c7e97ba82991 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:10,842 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:10,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 17:01:10,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:10,845 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 17:01:10,888 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/.tmp/f1/83df3764f99e40138b1f1339553da4a4 2023-02-16 17:01:10,902 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/.tmp/f1/99d8bf02296844b8a5ebb96991675052 2023-02-16 17:01:10,903 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/.tmp/f1/7f810427ef2745c1861b4c28d9be69fb 2023-02-16 17:01:10,903 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/.tmp/f1/9cb8853bf4b349bcbb563ff6193ac336 2023-02-16 17:01:10,903 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/.tmp/f1/85ae5495c629477b85c58e8b95e1b76b 2023-02-16 17:01:10,903 WARN [DataStreamer for file /user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/.tmp/f1/e2a1dfc4705f4e32a6e23e3ee6efa399] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-16 17:01:10,904 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/.tmp/f1/e2a1dfc4705f4e32a6e23e3ee6efa399 2023-02-16 17:01:11,063 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/.tmp/f2/68a2107048944b64a6534d2ead37d591 2023-02-16 17:01:11,066 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/.tmp/f2/e83f91a78c1343f78fa2d1957f819843 2023-02-16 17:01:11,066 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/.tmp/f2/96c5dfc366e5443fa7e99f4f29a5f9a2 2023-02-16 17:01:11,074 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/.tmp/f1/7f810427ef2745c1861b4c28d9be69fb as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1/7f810427ef2745c1861b4c28d9be69fb 2023-02-16 17:01:11,076 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/.tmp/f1/85ae5495c629477b85c58e8b95e1b76b as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1/85ae5495c629477b85c58e8b95e1b76b 2023-02-16 17:01:11,076 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/.tmp/f1/99d8bf02296844b8a5ebb96991675052 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1/99d8bf02296844b8a5ebb96991675052 2023-02-16 17:01:11,084 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1/7f810427ef2745c1861b4c28d9be69fb, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 17:01:11,086 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1/85ae5495c629477b85c58e8b95e1b76b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:11,086 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1/99d8bf02296844b8a5ebb96991675052, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:11,088 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/.tmp/f2/68a2107048944b64a6534d2ead37d591 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2/68a2107048944b64a6534d2ead37d591 2023-02-16 17:01:11,088 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/.tmp/f2/96c5dfc366e5443fa7e99f4f29a5f9a2 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2/96c5dfc366e5443fa7e99f4f29a5f9a2 2023-02-16 17:01:11,088 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/.tmp/f2/e83f91a78c1343f78fa2d1957f819843 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2/e83f91a78c1343f78fa2d1957f819843 2023-02-16 17:01:11,097 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2/68a2107048944b64a6534d2ead37d591, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 17:01:11,098 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2/96c5dfc366e5443fa7e99f4f29a5f9a2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:11,098 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2/e83f91a78c1343f78fa2d1957f819843, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:11,099 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 362aaa800a6f24c8e691ce188edeecec in 428ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:11,100 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for dba382119e74f3337a2e4dde935e21ed in 370ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:11,100 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3387c5fcea518e8693a59cfd54f1842e in 429ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:11,101 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 17:01:11,101 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 17:01:11,101 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3387c5fcea518e8693a59cfd54f1842e: 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 362aaa800a6f24c8e691ce188edeecec: 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for dba382119e74f3337a2e4dde935e21ed: 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1/7f810427ef2745c1861b4c28d9be69fb] hfiles 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1/85ae5495c629477b85c58e8b95e1b76b] hfiles 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1/7f810427ef2745c1861b4c28d9be69fb for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1/99d8bf02296844b8a5ebb96991675052] hfiles 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1/85ae5495c629477b85c58e8b95e1b76b for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,104 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1/99d8bf02296844b8a5ebb96991675052 for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,108 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2/96c5dfc366e5443fa7e99f4f29a5f9a2] hfiles 2023-02-16 17:01:11,108 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2/68a2107048944b64a6534d2ead37d591] hfiles 2023-02-16 17:01:11,108 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2/e83f91a78c1343f78fa2d1957f819843] hfiles 2023-02-16 17:01:11,108 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2/68a2107048944b64a6534d2ead37d591 for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,108 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2/96c5dfc366e5443fa7e99f4f29a5f9a2 for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,108 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2/e83f91a78c1343f78fa2d1957f819843 for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,142 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. completed. 2023-02-16 17:01:11,142 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:11,143 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 17:01:11,144 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. completed. 2023-02-16 17:01:11,144 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:11,144 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:11,144 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 17:01:11,144 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. started... 2023-02-16 17:01:11,145 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 8adbcab08ea9bcb78f6d7bee68684036 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:11,161 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/.tmp/f1/0c2415f7016643d4b27bbf61721c69c8 2023-02-16 17:01:11,190 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/.tmp/f2/fe2ba832587d43739c7a61bb2aac5a21 2023-02-16 17:01:11,198 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/.tmp/f1/0c2415f7016643d4b27bbf61721c69c8 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1/0c2415f7016643d4b27bbf61721c69c8 2023-02-16 17:01:11,205 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1/0c2415f7016643d4b27bbf61721c69c8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:11,207 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/.tmp/f2/fe2ba832587d43739c7a61bb2aac5a21 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2/fe2ba832587d43739c7a61bb2aac5a21 2023-02-16 17:01:11,213 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2/fe2ba832587d43739c7a61bb2aac5a21, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:11,214 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8adbcab08ea9bcb78f6d7bee68684036 in 69ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:11,215 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8adbcab08ea9bcb78f6d7bee68684036: 2023-02-16 17:01:11,215 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,215 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:11,215 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1/0c2415f7016643d4b27bbf61721c69c8] hfiles 2023-02-16 17:01:11,215 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1/0c2415f7016643d4b27bbf61721c69c8 for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,215 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2/fe2ba832587d43739c7a61bb2aac5a21] hfiles 2023-02-16 17:01:11,215 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2/fe2ba832587d43739c7a61bb2aac5a21 for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,224 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. completed. 2023-02-16 17:01:11,224 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:11,224 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:11,224 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 17:01:11,224 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. started... 2023-02-16 17:01:11,225 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3a316f18bc36030ad711981973302817 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:11,244 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/.tmp/f1/b5d9e055b37d4df7a91802ac3d9ab392 2023-02-16 17:01:11,294 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/.tmp/f2/f3cffff8d8ce407cab1ff35938e45194 2023-02-16 17:01:11,304 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/.tmp/f1/b5d9e055b37d4df7a91802ac3d9ab392 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1/b5d9e055b37d4df7a91802ac3d9ab392 2023-02-16 17:01:11,312 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1/b5d9e055b37d4df7a91802ac3d9ab392, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:11,314 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/.tmp/f2/f3cffff8d8ce407cab1ff35938e45194 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2/f3cffff8d8ce407cab1ff35938e45194 2023-02-16 17:01:11,321 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2/f3cffff8d8ce407cab1ff35938e45194, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:11,323 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3a316f18bc36030ad711981973302817 in 98ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:11,323 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3a316f18bc36030ad711981973302817: 2023-02-16 17:01:11,323 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,323 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:11,323 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1/b5d9e055b37d4df7a91802ac3d9ab392] hfiles 2023-02-16 17:01:11,323 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1/b5d9e055b37d4df7a91802ac3d9ab392 for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,323 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2/f3cffff8d8ce407cab1ff35938e45194] hfiles 2023-02-16 17:01:11,323 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2/f3cffff8d8ce407cab1ff35938e45194 for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,334 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. completed. 2023-02-16 17:01:11,335 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:11,335 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 17:01:11,345 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:11,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 17:01:11,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:11,347 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-16 17:01:11,454 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/.tmp/f2/3ca17f53333e4867b2a20151e200927b 2023-02-16 17:01:11,462 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/.tmp/f1/e2a1dfc4705f4e32a6e23e3ee6efa399 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1/e2a1dfc4705f4e32a6e23e3ee6efa399 2023-02-16 17:01:11,464 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/.tmp/f2/bb4fe2d9e6e5458e80a0f56af4af53a7 2023-02-16 17:01:11,465 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/.tmp/f2/706ea5d3ca8a495faffdf03a326d5dfa 2023-02-16 17:01:11,473 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/.tmp/f1/83df3764f99e40138b1f1339553da4a4 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1/83df3764f99e40138b1f1339553da4a4 2023-02-16 17:01:11,473 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1/e2a1dfc4705f4e32a6e23e3ee6efa399, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:11,473 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/.tmp/f1/9cb8853bf4b349bcbb563ff6193ac336 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1/9cb8853bf4b349bcbb563ff6193ac336 2023-02-16 17:01:11,475 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/.tmp/f2/3ca17f53333e4867b2a20151e200927b as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2/3ca17f53333e4867b2a20151e200927b 2023-02-16 17:01:11,481 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1/83df3764f99e40138b1f1339553da4a4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 17:01:11,482 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/.tmp/f2/706ea5d3ca8a495faffdf03a326d5dfa as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2/706ea5d3ca8a495faffdf03a326d5dfa 2023-02-16 17:01:11,483 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1/9cb8853bf4b349bcbb563ff6193ac336, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:11,484 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/.tmp/f2/bb4fe2d9e6e5458e80a0f56af4af53a7 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2/bb4fe2d9e6e5458e80a0f56af4af53a7 2023-02-16 17:01:11,485 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2/3ca17f53333e4867b2a20151e200927b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:11,487 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d0b64600fb3c2bef9100c7e97ba82991 in 754ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:11,487 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d0b64600fb3c2bef9100c7e97ba82991: 2023-02-16 17:01:11,487 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,487 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:11,487 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1/e2a1dfc4705f4e32a6e23e3ee6efa399] hfiles 2023-02-16 17:01:11,487 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1/e2a1dfc4705f4e32a6e23e3ee6efa399 for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,487 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2/3ca17f53333e4867b2a20151e200927b] hfiles 2023-02-16 17:01:11,487 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2/3ca17f53333e4867b2a20151e200927b for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,490 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2/706ea5d3ca8a495faffdf03a326d5dfa, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 17:01:11,492 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for dea97ec90688c064e4a226d52af25da0 in 820ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:11,492 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for dea97ec90688c064e4a226d52af25da0: 2023-02-16 17:01:11,492 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2/bb4fe2d9e6e5458e80a0f56af4af53a7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:11,492 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,492 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:11,492 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1/83df3764f99e40138b1f1339553da4a4] hfiles 2023-02-16 17:01:11,492 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1/83df3764f99e40138b1f1339553da4a4 for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,492 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2/706ea5d3ca8a495faffdf03a326d5dfa] hfiles 2023-02-16 17:01:11,492 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2/706ea5d3ca8a495faffdf03a326d5dfa for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,493 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 06fd504538972f7449bc0b3227fa4198 in 821ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:11,493 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 06fd504538972f7449bc0b3227fa4198: 2023-02-16 17:01:11,493 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,493 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:11,493 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1/9cb8853bf4b349bcbb563ff6193ac336] hfiles 2023-02-16 17:01:11,493 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1/9cb8853bf4b349bcbb563ff6193ac336 for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,493 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2/bb4fe2d9e6e5458e80a0f56af4af53a7] hfiles 2023-02-16 17:01:11,493 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2/bb4fe2d9e6e5458e80a0f56af4af53a7 for snapshot=testWithMapReduceMultiRegion 2023-02-16 17:01:11,515 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. completed. 2023-02-16 17:01:11,515 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:11,517 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 17:01:11,522 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. completed. 2023-02-16 17:01:11,522 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:11,523 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 17:01:11,523 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 17:01:11,523 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,523 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-16 17:01:11,523 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,41601,1676566863467' in zk 2023-02-16 17:01:11,523 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. completed. 2023-02-16 17:01:11,523 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:11,523 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 17:01:11,528 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-16 17:01:11,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:11,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:11,529 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:11,529 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-16 17:01:11,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:11,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:11,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 17:01:11,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:11,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:11,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 17:01:11,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,41601,1676566863467': 2023-02-16 17:01:11,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41601,1676566863467' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 17:01:11,543 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. completed. 2023-02-16 17:01:11,543 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:11,543 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 17:01:11,543 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 17:01:11,543 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:11,544 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-16 17:01:11,544 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34397,1676566863389' in zk 2023-02-16 17:01:11,546 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:11,546 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-16 17:01:11,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:11,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:11,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:11,546 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:11,546 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-16 17:01:11,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:11,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:11,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 17:01:11,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:11,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:11,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 17:01:11,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:11,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34397,1676566863389': 2023-02-16 17:01:11,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34397,1676566863389' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 17:01:11,551 INFO [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-16 17:01:11,551 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:11,551 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:11,551 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-16 17:01:11,551 INFO [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 17:01:11,554 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:11,554 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:11,554 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:11,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:11,554 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:11,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:11,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:11,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:11,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:11,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:11,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:11,554 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:11,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:11,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:11,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:11,555 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:11,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:11,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:11,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 17:01:11,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:11,556 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:11,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:11,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 17:01:11,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:11,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:11,558 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:11,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-16 17:01:11,559 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:11,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,575 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,575 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:11,575 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:11,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:11,575 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-16 17:01:11,575 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 17:01:11,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:11,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-16 17:01:11,575 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:11,575 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:11,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:11,576 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:11,575 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:11,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:11,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:11,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:11,576 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-16 17:01:11,577 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:11,577 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:11,577 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:11,577 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-16 17:01:11,577 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-16 17:01:11,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:11,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:11,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 17:01:11,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-16 17:01:11,701 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-16 17:01:11,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 17:01:11,702 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-16 17:01:11,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676566870206Consolidate snapshot: testWithMapReduceMultiRegion at 1676566871575 (+1369 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676566871576 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1676566871614 (+38 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676566871641 (+27 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676566871701 (+60 ms) 2023-02-16 17:01:11,704 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 17:01:11,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.4950 sec 2023-02-16 17:01:11,794 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-16 17:01:11,873 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-16 17:01:11,875 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-16 17:01:12,288 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 17:01:12,289 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-16 17:01:12,348 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:12,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 17:01:12,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 17:01:12,350 INFO [Listener at localhost/43373] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 17:01:12,360 INFO [Listener at localhost/43373] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 17:01:12,372 INFO [Listener at localhost/43373] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 17:01:12,434 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41601] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:12,459 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34397] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:12,632 INFO [Listener at localhost/43373] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 17:01:12,650 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 17:01:12,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 17:01:12,657 INFO [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 17:01:12,657 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:12,658 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 17:01:12,658 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 17:01:12,658 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:12,659 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:12,660 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:12,660 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:12,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:12,660 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:12,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:12,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:12,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:12,661 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:12,661 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:12,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:12,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:12,661 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:12,661 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:12,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:12,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:12,662 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 17:01:12,662 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 17:01:12,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 17:01:12,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 17:01:12,664 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 17:01:12,664 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:12,664 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 17:01:12,665 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 17:01:12,665 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:12,666 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 17:01:12,667 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:12,667 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:12,667 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. started... 2023-02-16 17:01:12,667 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. started... 2023-02-16 17:01:12,667 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:12,667 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 24d6989912aa4c5c32a50fd8baf30fcc: 2023-02-16 17:01:12,667 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3387c5fcea518e8693a59cfd54f1842e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:12,667 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. started... 2023-02-16 17:01:12,667 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 06fd504538972f7449bc0b3227fa4198 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:12,667 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:12,673 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:12,673 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 17:01:12,673 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:12,673 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 17:01:12,673 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. started... 2023-02-16 17:01:12,673 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 17:01:12,673 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 362aaa800a6f24c8e691ce188edeecec 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 17:01:12,673 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. started... 2023-02-16 17:01:12,674 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing dba382119e74f3337a2e4dde935e21ed 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:12,676 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 17:01:12,676 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 17:01:12,676 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:12,676 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:12,676 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. started... 2023-02-16 17:01:12,676 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. started... 2023-02-16 17:01:12,676 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e1a7443ba00bdedeceff74e5c3ff1dc4: 2023-02-16 17:01:12,676 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:12,676 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing dea97ec90688c064e4a226d52af25da0 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 17:01:12,680 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:12,680 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 17:01:12,681 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. started... 2023-02-16 17:01:12,681 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d0b64600fb3c2bef9100c7e97ba82991 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:12,761 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/.tmp/f1/c41b20b6121e4da59aafc1d504b1131f 2023-02-16 17:01:12,789 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/.tmp/f1/f6e08e9dc6114c5ca1025655166b19ad 2023-02-16 17:01:12,791 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/.tmp/f1/2052dd3f78964f43b3e88e7568de618b 2023-02-16 17:01:12,801 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/.tmp/f1/2bb0f89e11624f2f88703c2bacc8eed2 2023-02-16 17:01:12,817 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/.tmp/f1/56d6de5d923a47e294fb1f74ef7a9fec 2023-02-16 17:01:12,826 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/.tmp/f2/9af61fc7ec054dffb736876779eb288f 2023-02-16 17:01:12,826 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/.tmp/f1/7e36852e0d7b49ed8bf02f22dcd6b24f 2023-02-16 17:01:12,839 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/.tmp/f2/3686f9a2ca6b4c009dfae0dc91218302 2023-02-16 17:01:12,840 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/.tmp/f1/c41b20b6121e4da59aafc1d504b1131f as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1/c41b20b6121e4da59aafc1d504b1131f 2023-02-16 17:01:12,847 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/.tmp/f1/f6e08e9dc6114c5ca1025655166b19ad as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1/f6e08e9dc6114c5ca1025655166b19ad 2023-02-16 17:01:12,848 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1/c41b20b6121e4da59aafc1d504b1131f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:12,851 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/.tmp/f2/9af61fc7ec054dffb736876779eb288f as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2/9af61fc7ec054dffb736876779eb288f 2023-02-16 17:01:12,856 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/.tmp/f2/f02ff7a921fe4421aad186d2a3bfd8af 2023-02-16 17:01:12,858 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2/9af61fc7ec054dffb736876779eb288f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:12,859 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 06fd504538972f7449bc0b3227fa4198 in 192ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:12,859 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 06fd504538972f7449bc0b3227fa4198: 2023-02-16 17:01:12,859 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:12,859 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 17:01:12,862 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/.tmp/f1/2052dd3f78964f43b3e88e7568de618b as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1/2052dd3f78964f43b3e88e7568de618b 2023-02-16 17:01:12,864 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/.tmp/f2/f27045d051c54685b09c7121c1e149af 2023-02-16 17:01:12,866 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1/f6e08e9dc6114c5ca1025655166b19ad, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 17:01:12,867 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/.tmp/f2/3686f9a2ca6b4c009dfae0dc91218302 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2/3686f9a2ca6b4c009dfae0dc91218302 2023-02-16 17:01:12,872 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/.tmp/f1/2bb0f89e11624f2f88703c2bacc8eed2 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1/2bb0f89e11624f2f88703c2bacc8eed2 2023-02-16 17:01:12,872 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/.tmp/f2/91e8235679834b73b60360dd2ed3c7fd 2023-02-16 17:01:12,876 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1/2052dd3f78964f43b3e88e7568de618b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:12,877 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/.tmp/f2/f02ff7a921fe4421aad186d2a3bfd8af as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2/f02ff7a921fe4421aad186d2a3bfd8af 2023-02-16 17:01:12,879 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2/3686f9a2ca6b4c009dfae0dc91218302, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 17:01:12,880 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 362aaa800a6f24c8e691ce188edeecec in 207ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:12,881 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 362aaa800a6f24c8e691ce188edeecec: 2023-02-16 17:01:12,881 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:12,881 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:12,881 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 17:01:12,881 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. started... 2023-02-16 17:01:12,881 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8adbcab08ea9bcb78f6d7bee68684036 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:12,885 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/.tmp/f1/56d6de5d923a47e294fb1f74ef7a9fec as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1/56d6de5d923a47e294fb1f74ef7a9fec 2023-02-16 17:01:12,888 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1/2bb0f89e11624f2f88703c2bacc8eed2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:12,888 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/.tmp/f2/ad8024c3b8f540a78de106bf7eb06577 2023-02-16 17:01:12,892 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/.tmp/f2/f27045d051c54685b09c7121c1e149af as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2/f27045d051c54685b09c7121c1e149af 2023-02-16 17:01:12,892 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2/f02ff7a921fe4421aad186d2a3bfd8af, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:12,895 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for dba382119e74f3337a2e4dde935e21ed in 221ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:12,896 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for dba382119e74f3337a2e4dde935e21ed: 2023-02-16 17:01:12,896 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:12,896 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 17:01:12,897 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/.tmp/f1/7e36852e0d7b49ed8bf02f22dcd6b24f as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1/7e36852e0d7b49ed8bf02f22dcd6b24f 2023-02-16 17:01:12,905 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1/56d6de5d923a47e294fb1f74ef7a9fec, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:12,906 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/.tmp/f2/91e8235679834b73b60360dd2ed3c7fd as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2/91e8235679834b73b60360dd2ed3c7fd 2023-02-16 17:01:12,908 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1/7e36852e0d7b49ed8bf02f22dcd6b24f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 17:01:12,909 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/.tmp/f2/ad8024c3b8f540a78de106bf7eb06577 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2/ad8024c3b8f540a78de106bf7eb06577 2023-02-16 17:01:12,911 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2/f27045d051c54685b09c7121c1e149af, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:12,912 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3387c5fcea518e8693a59cfd54f1842e in 245ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:12,913 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3387c5fcea518e8693a59cfd54f1842e: 2023-02-16 17:01:12,913 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:12,913 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:12,913 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 17:01:12,913 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. started... 2023-02-16 17:01:12,913 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3a316f18bc36030ad711981973302817 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:12,921 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2/ad8024c3b8f540a78de106bf7eb06577, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 17:01:12,923 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for dea97ec90688c064e4a226d52af25da0 in 246ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:12,923 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for dea97ec90688c064e4a226d52af25da0: 2023-02-16 17:01:12,923 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:12,923 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 17:01:12,926 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2/91e8235679834b73b60360dd2ed3c7fd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:12,927 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/.tmp/f1/eac61374bd374e85b7e53c00d1a2a77c 2023-02-16 17:01:12,928 INFO [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d0b64600fb3c2bef9100c7e97ba82991 in 247ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:12,928 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d0b64600fb3c2bef9100c7e97ba82991: 2023-02-16 17:01:12,928 DEBUG [rs(jenkins-hbase4.apache.org,41601,1676566863467)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:12,928 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 17:01:12,928 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 17:01:12,928 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:12,928 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 17:01:12,928 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41601,1676566863467' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 17:01:12,932 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:12,932 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:12,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:12,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:12,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:12,933 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:12,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:12,933 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:12,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:12,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:12,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:12,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:12,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41601,1676566863467' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 17:01:12,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56a870d2[Count = 1] remaining members to acquire global barrier 2023-02-16 17:01:12,944 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/.tmp/f1/6972a8c4d5b24a3198cce65efb80d568 2023-02-16 17:01:12,963 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/.tmp/f2/e89451ac76204f5aa57fc2bf271a0813 2023-02-16 17:01:12,969 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/.tmp/f1/eac61374bd374e85b7e53c00d1a2a77c as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1/eac61374bd374e85b7e53c00d1a2a77c 2023-02-16 17:01:12,972 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/.tmp/f2/aa4e6e10d046430399fd1d2e108fca33 2023-02-16 17:01:12,975 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1/eac61374bd374e85b7e53c00d1a2a77c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:12,976 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/.tmp/f2/e89451ac76204f5aa57fc2bf271a0813 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2/e89451ac76204f5aa57fc2bf271a0813 2023-02-16 17:01:12,982 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2/e89451ac76204f5aa57fc2bf271a0813, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:12,983 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8adbcab08ea9bcb78f6d7bee68684036 in 102ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:12,983 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8adbcab08ea9bcb78f6d7bee68684036: 2023-02-16 17:01:12,983 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:12,983 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 17:01:12,984 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/.tmp/f1/6972a8c4d5b24a3198cce65efb80d568 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1/6972a8c4d5b24a3198cce65efb80d568 2023-02-16 17:01:12,989 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1/6972a8c4d5b24a3198cce65efb80d568, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:12,990 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/.tmp/f2/aa4e6e10d046430399fd1d2e108fca33 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2/aa4e6e10d046430399fd1d2e108fca33 2023-02-16 17:01:13,007 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2/aa4e6e10d046430399fd1d2e108fca33, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:13,009 INFO [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3a316f18bc36030ad711981973302817 in 96ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:13,009 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3a316f18bc36030ad711981973302817: 2023-02-16 17:01:13,009 DEBUG [rs(jenkins-hbase4.apache.org,34397,1676566863389)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:13,009 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 17:01:13,009 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 17:01:13,009 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,009 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 17:01:13,009 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34397,1676566863389' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 17:01:13,011 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,011 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:13,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:13,012 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:13,012 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:13,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34397,1676566863389' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 17:01:13,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56a870d2[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:13,014 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 17:01:13,015 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:13,018 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:13,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:13,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:13,018 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 17:01:13,018 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 17:01:13,018 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,34397,1676566863389' in zk 2023-02-16 17:01:13,018 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,019 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,019 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:13,020 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,020 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 17:01:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,020 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:13,020 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:13,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:13,021 DEBUG [member: 'jenkins-hbase4.apache.org,34397,1676566863389' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 17:01:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:13,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:13,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:13,021 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 17:01:13,021 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 17:01:13,022 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41601,1676566863467' in zk 2023-02-16 17:01:13,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:13,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:13,023 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:13,023 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 17:01:13,023 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:13,023 DEBUG [member: 'jenkins-hbase4.apache.org,41601,1676566863467' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 17:01:13,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:13,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:13,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,34397,1676566863389': 2023-02-16 17:01:13,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34397,1676566863389' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-16 17:01:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:13,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:13,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:13,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:13,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:13,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:13,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:13,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,41601,1676566863467': 2023-02-16 17:01:13,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41601,1676566863467' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 17:01:13,031 INFO [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 17:01:13,032 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:13,032 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:13,032 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 17:01:13,032 INFO [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 17:01:13,034 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:13,034 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:13,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:13,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:13,034 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:13,034 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:13,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:13,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:13,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:13,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:13,034 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:13,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:13,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:13,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:13,035 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:13,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:13,036 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:13,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:13,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:13,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,039 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:13,039 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:13,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,052 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:13,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:13,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:13,052 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:13,052 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,052 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:13,052 DEBUG [(jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:13,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:13,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:13,052 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:13,052 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 17:01:13,053 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 17:01:13,052 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:13,053 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,053 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:13,053 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:13,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:13,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:13,053 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:13,054 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:13,054 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:13,054 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:13,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:13,056 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:13,056 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 17:01:13,156 DEBUG [Listener at localhost/43373] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 17:01:13,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 17:01:13,275 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/hadoop-2571998195192181997.jar 2023-02-16 17:01:13,293 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676566870157 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:13,294 DEBUG [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce 2023-02-16 17:01:13,295 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(239): region to add: 24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:13,295 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(239): region to add: 3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:13,295 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(239): region to add: 06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:13,295 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(239): region to add: 362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:13,295 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(239): region to add: e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:13,295 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(239): region to add: dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:13,295 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(239): region to add: d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:13,295 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(239): region to add: dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:13,295 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(239): region to add: 3a316f18bc36030ad711981973302817 2023-02-16 17:01:13,296 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(239): region to add: 8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:13,296 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(585): clone region=24d6989912aa4c5c32a50fd8baf30fcc as 24d6989912aa4c5c32a50fd8baf30fcc in snapshot testWithMapReduceMultiRegion 2023-02-16 17:01:13,296 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(585): clone region=3387c5fcea518e8693a59cfd54f1842e as 3387c5fcea518e8693a59cfd54f1842e in snapshot testWithMapReduceMultiRegion 2023-02-16 17:01:13,296 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(585): clone region=06fd504538972f7449bc0b3227fa4198 as 06fd504538972f7449bc0b3227fa4198 in snapshot testWithMapReduceMultiRegion 2023-02-16 17:01:13,296 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(585): clone region=362aaa800a6f24c8e691ce188edeecec as 362aaa800a6f24c8e691ce188edeecec in snapshot testWithMapReduceMultiRegion 2023-02-16 17:01:13,296 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(585): clone region=e1a7443ba00bdedeceff74e5c3ff1dc4 as e1a7443ba00bdedeceff74e5c3ff1dc4 in snapshot testWithMapReduceMultiRegion 2023-02-16 17:01:13,296 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(585): clone region=dba382119e74f3337a2e4dde935e21ed as dba382119e74f3337a2e4dde935e21ed in snapshot testWithMapReduceMultiRegion 2023-02-16 17:01:13,296 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(585): clone region=d0b64600fb3c2bef9100c7e97ba82991 as d0b64600fb3c2bef9100c7e97ba82991 in snapshot testWithMapReduceMultiRegion 2023-02-16 17:01:13,296 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(585): clone region=dea97ec90688c064e4a226d52af25da0 as dea97ec90688c064e4a226d52af25da0 in snapshot testWithMapReduceMultiRegion 2023-02-16 17:01:13,296 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(585): clone region=3a316f18bc36030ad711981973302817 as 3a316f18bc36030ad711981973302817 in snapshot testWithMapReduceMultiRegion 2023-02-16 17:01:13,296 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(585): clone region=8adbcab08ea9bcb78f6d7bee68684036 as 8adbcab08ea9bcb78f6d7bee68684036 in snapshot testWithMapReduceMultiRegion 2023-02-16 17:01:13,305 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 06fd504538972f7449bc0b3227fa4198, NAME => 'testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758 2023-02-16 17:01:13,305 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3387c5fcea518e8693a59cfd54f1842e, NAME => 'testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758 2023-02-16 17:01:13,306 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 362aaa800a6f24c8e691ce188edeecec, NAME => 'testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758 2023-02-16 17:01:13,306 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 24d6989912aa4c5c32a50fd8baf30fcc, NAME => 'testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758 2023-02-16 17:01:13,306 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => e1a7443ba00bdedeceff74e5c3ff1dc4, NAME => 'testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758 2023-02-16 17:01:13,306 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => d0b64600fb3c2bef9100c7e97ba82991, NAME => 'testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758 2023-02-16 17:01:13,307 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => dea97ec90688c064e4a226d52af25da0, NAME => 'testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758 2023-02-16 17:01:13,307 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => dba382119e74f3337a2e4dde935e21ed, NAME => 'testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758 2023-02-16 17:01:13,349 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:13,349 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 99d8bf02296844b8a5ebb96991675052 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,360 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:13,361 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 24d6989912aa4c5c32a50fd8baf30fcc, disabling compactions & flushes 2023-02-16 17:01:13,361 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:13,361 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:13,361 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. after waiting 0 ms 2023-02-16 17:01:13,361 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:13,361 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:13,361 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 24d6989912aa4c5c32a50fd8baf30fcc: 2023-02-16 17:01:13,361 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e83f91a78c1343f78fa2d1957f819843 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,362 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3a316f18bc36030ad711981973302817, NAME => 'testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758 2023-02-16 17:01:13,372 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:13,372 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:13,372 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e2a1dfc4705f4e32a6e23e3ee6efa399 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,372 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 85ae5495c629477b85c58e8b95e1b76b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,372 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:13,372 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing e1a7443ba00bdedeceff74e5c3ff1dc4, disabling compactions & flushes 2023-02-16 17:01:13,372 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:13,372 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:13,372 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. after waiting 0 ms 2023-02-16 17:01:13,372 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:13,372 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:13,373 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for e1a7443ba00bdedeceff74e5c3ff1dc4: 2023-02-16 17:01:13,373 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 8adbcab08ea9bcb78f6d7bee68684036, NAME => 'testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758 2023-02-16 17:01:13,375 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 3387c5fcea518e8693a59cfd54f1842e, disabling compactions & flushes 2023-02-16 17:01:13,375 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:13,375 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:13,375 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. after waiting 0 ms 2023-02-16 17:01:13,375 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:13,375 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:13,375 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 3387c5fcea518e8693a59cfd54f1842e: 2023-02-16 17:01:13,379 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:13,380 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 83df3764f99e40138b1f1339553da4a4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,392 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 96c5dfc366e5443fa7e99f4f29a5f9a2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,392 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3ca17f53333e4867b2a20151e200927b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,404 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing dba382119e74f3337a2e4dde935e21ed, disabling compactions & flushes 2023-02-16 17:01:13,404 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:13,404 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:13,404 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. after waiting 0 ms 2023-02-16 17:01:13,404 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:13,404 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:13,405 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for dba382119e74f3337a2e4dde935e21ed: 2023-02-16 17:01:13,405 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 706ea5d3ca8a495faffdf03a326d5dfa from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,405 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:13,405 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b5d9e055b37d4df7a91802ac3d9ab392 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,405 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing d0b64600fb3c2bef9100c7e97ba82991, disabling compactions & flushes 2023-02-16 17:01:13,406 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:13,406 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:13,406 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. after waiting 0 ms 2023-02-16 17:01:13,406 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:13,406 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:13,406 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for d0b64600fb3c2bef9100c7e97ba82991: 2023-02-16 17:01:13,416 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:13,416 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f3cffff8d8ce407cab1ff35938e45194 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,416 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0c2415f7016643d4b27bbf61721c69c8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,417 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing dea97ec90688c064e4a226d52af25da0, disabling compactions & flushes 2023-02-16 17:01:13,417 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:13,417 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:13,417 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. after waiting 0 ms 2023-02-16 17:01:13,417 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:13,417 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:13,417 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for dea97ec90688c064e4a226d52af25da0: 2023-02-16 17:01:13,424 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fe2ba832587d43739c7a61bb2aac5a21 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,425 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 3a316f18bc36030ad711981973302817, disabling compactions & flushes 2023-02-16 17:01:13,425 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:13,425 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:13,425 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. after waiting 0 ms 2023-02-16 17:01:13,425 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:13,425 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:13,425 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 3a316f18bc36030ad711981973302817: 2023-02-16 17:01:13,427 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 8adbcab08ea9bcb78f6d7bee68684036, disabling compactions & flushes 2023-02-16 17:01:13,427 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:13,427 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:13,427 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. after waiting 0 ms 2023-02-16 17:01:13,427 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:13,427 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:13,427 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 8adbcab08ea9bcb78f6d7bee68684036: 2023-02-16 17:01:13,731 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:13,731 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9cb8853bf4b349bcbb563ff6193ac336 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,734 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bb4fe2d9e6e5458e80a0f56af4af53a7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,737 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 06fd504538972f7449bc0b3227fa4198, disabling compactions & flushes 2023-02-16 17:01:13,737 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:13,737 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:13,737 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. after waiting 0 ms 2023-02-16 17:01:13,737 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:13,737 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:13,737 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 06fd504538972f7449bc0b3227fa4198: 2023-02-16 17:01:13,741 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:13,741 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7f810427ef2745c1861b4c28d9be69fb from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,743 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 68a2107048944b64a6534d2ead37d591 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-16 17:01:13,745 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 362aaa800a6f24c8e691ce188edeecec, disabling compactions & flushes 2023-02-16 17:01:13,746 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:13,746 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:13,746 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. after waiting 0 ms 2023-02-16 17:01:13,746 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:13,746 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:13,746 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 362aaa800a6f24c8e691ce188edeecec: 2023-02-16 17:01:13,746 INFO [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676566870157 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:13,746 DEBUG [Listener at localhost/43373] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758 2023-02-16 17:01:13,746 DEBUG [Listener at localhost/43373] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758 2023-02-16 17:01:13,747 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-data/ 2023-02-16 17:01:13,748 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |----default/ 2023-02-16 17:01:13,748 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 17:01:13,749 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |----------06fd504538972f7449bc0b3227fa4198/ 2023-02-16 17:01:13,750 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:13,750 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:13,751 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=06fd504538972f7449bc0b3227fa4198-9cb8853bf4b349bcbb563ff6193ac336 2023-02-16 17:01:13,751 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:13,751 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=06fd504538972f7449bc0b3227fa4198-bb4fe2d9e6e5458e80a0f56af4af53a7 2023-02-16 17:01:13,751 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |----------24d6989912aa4c5c32a50fd8baf30fcc/ 2023-02-16 17:01:13,752 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:13,752 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |----------3387c5fcea518e8693a59cfd54f1842e/ 2023-02-16 17:01:13,753 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:13,753 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:13,753 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=3387c5fcea518e8693a59cfd54f1842e-99d8bf02296844b8a5ebb96991675052 2023-02-16 17:01:13,753 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:13,754 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=3387c5fcea518e8693a59cfd54f1842e-e83f91a78c1343f78fa2d1957f819843 2023-02-16 17:01:13,754 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |----------362aaa800a6f24c8e691ce188edeecec/ 2023-02-16 17:01:13,755 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:13,755 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:13,755 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=362aaa800a6f24c8e691ce188edeecec-7f810427ef2745c1861b4c28d9be69fb 2023-02-16 17:01:13,755 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:13,756 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=362aaa800a6f24c8e691ce188edeecec-68a2107048944b64a6534d2ead37d591 2023-02-16 17:01:13,756 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |----------3a316f18bc36030ad711981973302817/ 2023-02-16 17:01:13,756 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:13,756 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:13,757 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=3a316f18bc36030ad711981973302817-b5d9e055b37d4df7a91802ac3d9ab392 2023-02-16 17:01:13,757 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:13,757 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=3a316f18bc36030ad711981973302817-f3cffff8d8ce407cab1ff35938e45194 2023-02-16 17:01:13,757 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |----------8adbcab08ea9bcb78f6d7bee68684036/ 2023-02-16 17:01:13,758 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:13,758 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:13,758 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=8adbcab08ea9bcb78f6d7bee68684036-0c2415f7016643d4b27bbf61721c69c8 2023-02-16 17:01:13,758 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:13,759 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=8adbcab08ea9bcb78f6d7bee68684036-fe2ba832587d43739c7a61bb2aac5a21 2023-02-16 17:01:13,759 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |----------d0b64600fb3c2bef9100c7e97ba82991/ 2023-02-16 17:01:13,760 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:13,760 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:13,760 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=d0b64600fb3c2bef9100c7e97ba82991-e2a1dfc4705f4e32a6e23e3ee6efa399 2023-02-16 17:01:13,761 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:13,761 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=d0b64600fb3c2bef9100c7e97ba82991-3ca17f53333e4867b2a20151e200927b 2023-02-16 17:01:13,761 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |----------dba382119e74f3337a2e4dde935e21ed/ 2023-02-16 17:01:13,762 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:13,762 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:13,763 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=dba382119e74f3337a2e4dde935e21ed-85ae5495c629477b85c58e8b95e1b76b 2023-02-16 17:01:13,763 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:13,763 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=dba382119e74f3337a2e4dde935e21ed-96c5dfc366e5443fa7e99f4f29a5f9a2 2023-02-16 17:01:13,763 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |----------dea97ec90688c064e4a226d52af25da0/ 2023-02-16 17:01:13,764 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:13,764 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:13,765 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=dea97ec90688c064e4a226d52af25da0-83df3764f99e40138b1f1339553da4a4 2023-02-16 17:01:13,765 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:13,765 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |----------------testWithMapReduce=dea97ec90688c064e4a226d52af25da0-706ea5d3ca8a495faffdf03a326d5dfa 2023-02-16 17:01:13,765 DEBUG [Listener at localhost/43373] util.CommonFSUtils(699): |----------e1a7443ba00bdedeceff74e5c3ff1dc4/ 2023-02-16 17:01:13,766 DEBUG [Listener at localhost/43373] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:13,775 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:13,775 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:13,776 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:13,776 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:14,720 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/hadoop-8484743465190067039.jar 2023-02-16 17:01:14,721 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:14,721 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:14,792 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/hadoop-2060383233729735789.jar 2023-02-16 17:01:14,793 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:14,793 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:14,794 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:14,794 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:14,795 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:14,795 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:14,795 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 17:01:14,796 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 17:01:14,797 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 17:01:14,797 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 17:01:14,798 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 17:01:14,799 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 17:01:14,799 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 17:01:14,800 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 17:01:14,800 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 17:01:14,801 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 17:01:14,810 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:14,810 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 17:01:14,811 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 17:01:14,812 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 17:01:14,812 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 17:01:14,881 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/hadoop-8059379925605658545.jar 2023-02-16 17:01:14,881 DEBUG [Listener at localhost/43373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 17:01:14,935 WARN [Listener at localhost/43373] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 17:01:14,946 WARN [Listener at localhost/43373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-16 17:01:14,959 INFO [Listener at localhost/43373] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 17:01:15,362 WARN [Listener at localhost/43373] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/mapreduce.cluster.local.dir/1676566875277/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 17:01:15,362 WARN [Listener at localhost/43373] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/mapreduce.cluster.local.dir/1676566875277/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 17:01:15,542 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:15,542 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:15,548 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:15,550 INFO [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:15,552 DEBUG [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1 2023-02-16 17:01:15,554 INFO [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06fd504538972f7449bc0b3227fa4198 columnFamilyName f1 2023-02-16 17:01:15,562 DEBUG [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1/testWithMapReduce=06fd504538972f7449bc0b3227fa4198-9cb8853bf4b349bcbb563ff6193ac336 2023-02-16 17:01:15,563 INFO [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] regionserver.HStore(310): Store=06fd504538972f7449bc0b3227fa4198/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:15,563 INFO [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:15,564 DEBUG [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2 2023-02-16 17:01:15,564 INFO [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06fd504538972f7449bc0b3227fa4198 columnFamilyName f2 2023-02-16 17:01:15,571 DEBUG [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2/testWithMapReduce=06fd504538972f7449bc0b3227fa4198-bb4fe2d9e6e5458e80a0f56af4af53a7 2023-02-16 17:01:15,571 INFO [StoreOpener-06fd504538972f7449bc0b3227fa4198-1] regionserver.HStore(310): Store=06fd504538972f7449bc0b3227fa4198/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:15,571 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:15,572 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 06fd504538972f7449bc0b3227fa4198; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68989736, jitterRate=0.02802717685699463}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:15,572 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 06fd504538972f7449bc0b3227fa4198: 2023-02-16 17:01:15,743 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 06fd504538972f7449bc0b3227fa4198, disabling compactions & flushes 2023-02-16 17:01:15,743 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:15,743 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:15,743 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. after waiting 0 ms 2023-02-16 17:01:15,744 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:15,749 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:15,749 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 06fd504538972f7449bc0b3227fa4198: 2023-02-16 17:01:15,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:15,793 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:15,794 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:15,800 INFO [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:15,801 DEBUG [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1 2023-02-16 17:01:15,802 INFO [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3387c5fcea518e8693a59cfd54f1842e columnFamilyName f1 2023-02-16 17:01:15,808 DEBUG [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1/testWithMapReduce=3387c5fcea518e8693a59cfd54f1842e-99d8bf02296844b8a5ebb96991675052 2023-02-16 17:01:15,808 INFO [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] regionserver.HStore(310): Store=3387c5fcea518e8693a59cfd54f1842e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:15,808 INFO [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:15,809 DEBUG [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2 2023-02-16 17:01:15,809 INFO [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3387c5fcea518e8693a59cfd54f1842e columnFamilyName f2 2023-02-16 17:01:15,815 DEBUG [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2/testWithMapReduce=3387c5fcea518e8693a59cfd54f1842e-e83f91a78c1343f78fa2d1957f819843 2023-02-16 17:01:15,815 INFO [StoreOpener-3387c5fcea518e8693a59cfd54f1842e-1] regionserver.HStore(310): Store=3387c5fcea518e8693a59cfd54f1842e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:15,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:15,816 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3387c5fcea518e8693a59cfd54f1842e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72996561, jitterRate=0.08773352205753326}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:15,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3387c5fcea518e8693a59cfd54f1842e: 2023-02-16 17:01:15,884 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3387c5fcea518e8693a59cfd54f1842e, disabling compactions & flushes 2023-02-16 17:01:15,885 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:15,885 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:15,885 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. after waiting 0 ms 2023-02-16 17:01:15,885 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:15,887 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:15,887 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3387c5fcea518e8693a59cfd54f1842e: 2023-02-16 17:01:15,893 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:15,893 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:15,894 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:15,896 INFO [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:15,898 DEBUG [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/f1 2023-02-16 17:01:15,898 INFO [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24d6989912aa4c5c32a50fd8baf30fcc columnFamilyName f1 2023-02-16 17:01:15,899 INFO [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] regionserver.HStore(310): Store=24d6989912aa4c5c32a50fd8baf30fcc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:15,899 INFO [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:15,901 DEBUG [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/f2 2023-02-16 17:01:15,901 INFO [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 24d6989912aa4c5c32a50fd8baf30fcc columnFamilyName f2 2023-02-16 17:01:15,902 INFO [StoreOpener-24d6989912aa4c5c32a50fd8baf30fcc-1] regionserver.HStore(310): Store=24d6989912aa4c5c32a50fd8baf30fcc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:15,902 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:15,902 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 24d6989912aa4c5c32a50fd8baf30fcc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70409304, jitterRate=0.04918038845062256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:15,902 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 24d6989912aa4c5c32a50fd8baf30fcc: 2023-02-16 17:01:15,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 24d6989912aa4c5c32a50fd8baf30fcc, disabling compactions & flushes 2023-02-16 17:01:15,922 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:15,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:15,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. after waiting 0 ms 2023-02-16 17:01:15,922 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:15,923 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:15,923 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 24d6989912aa4c5c32a50fd8baf30fcc: 2023-02-16 17:01:15,930 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:15,930 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:15,934 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:15,936 INFO [StoreOpener-3a316f18bc36030ad711981973302817-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3a316f18bc36030ad711981973302817 2023-02-16 17:01:15,937 DEBUG [StoreOpener-3a316f18bc36030ad711981973302817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1 2023-02-16 17:01:15,938 INFO [StoreOpener-3a316f18bc36030ad711981973302817-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a316f18bc36030ad711981973302817 columnFamilyName f1 2023-02-16 17:01:15,944 DEBUG [StoreOpener-3a316f18bc36030ad711981973302817-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1/testWithMapReduce=3a316f18bc36030ad711981973302817-b5d9e055b37d4df7a91802ac3d9ab392 2023-02-16 17:01:15,944 INFO [StoreOpener-3a316f18bc36030ad711981973302817-1] regionserver.HStore(310): Store=3a316f18bc36030ad711981973302817/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:15,944 INFO [StoreOpener-3a316f18bc36030ad711981973302817-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3a316f18bc36030ad711981973302817 2023-02-16 17:01:15,945 DEBUG [StoreOpener-3a316f18bc36030ad711981973302817-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2 2023-02-16 17:01:15,946 INFO [StoreOpener-3a316f18bc36030ad711981973302817-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a316f18bc36030ad711981973302817 columnFamilyName f2 2023-02-16 17:01:15,952 DEBUG [StoreOpener-3a316f18bc36030ad711981973302817-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2/testWithMapReduce=3a316f18bc36030ad711981973302817-f3cffff8d8ce407cab1ff35938e45194 2023-02-16 17:01:15,952 INFO [StoreOpener-3a316f18bc36030ad711981973302817-1] regionserver.HStore(310): Store=3a316f18bc36030ad711981973302817/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:15,952 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:15,953 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3a316f18bc36030ad711981973302817; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71708928, jitterRate=0.06854629516601562}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:15,953 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3a316f18bc36030ad711981973302817: 2023-02-16 17:01:16,001 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3a316f18bc36030ad711981973302817, disabling compactions & flushes 2023-02-16 17:01:16,002 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:16,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:16,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. after waiting 0 ms 2023-02-16 17:01:16,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:16,004 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:16,005 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3a316f18bc36030ad711981973302817: 2023-02-16 17:01:16,008 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:16,008 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:16,012 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:16,014 INFO [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:16,015 DEBUG [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1 2023-02-16 17:01:16,015 INFO [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8adbcab08ea9bcb78f6d7bee68684036 columnFamilyName f1 2023-02-16 17:01:16,038 DEBUG [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1/testWithMapReduce=8adbcab08ea9bcb78f6d7bee68684036-0c2415f7016643d4b27bbf61721c69c8 2023-02-16 17:01:16,039 INFO [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] regionserver.HStore(310): Store=8adbcab08ea9bcb78f6d7bee68684036/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:16,039 INFO [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:16,040 DEBUG [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2 2023-02-16 17:01:16,041 INFO [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8adbcab08ea9bcb78f6d7bee68684036 columnFamilyName f2 2023-02-16 17:01:16,050 DEBUG [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2/testWithMapReduce=8adbcab08ea9bcb78f6d7bee68684036-fe2ba832587d43739c7a61bb2aac5a21 2023-02-16 17:01:16,051 INFO [StoreOpener-8adbcab08ea9bcb78f6d7bee68684036-1] regionserver.HStore(310): Store=8adbcab08ea9bcb78f6d7bee68684036/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:16,051 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:16,051 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8adbcab08ea9bcb78f6d7bee68684036; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64038184, jitterRate=-0.04575669765472412}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:16,051 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8adbcab08ea9bcb78f6d7bee68684036: 2023-02-16 17:01:16,220 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8adbcab08ea9bcb78f6d7bee68684036, disabling compactions & flushes 2023-02-16 17:01:16,221 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:16,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:16,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. after waiting 0 ms 2023-02-16 17:01:16,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:16,227 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:16,227 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8adbcab08ea9bcb78f6d7bee68684036: 2023-02-16 17:01:16,231 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:16,231 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:16,235 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:16,237 INFO [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:16,239 DEBUG [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1 2023-02-16 17:01:16,239 INFO [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 362aaa800a6f24c8e691ce188edeecec columnFamilyName f1 2023-02-16 17:01:16,246 DEBUG [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1/testWithMapReduce=362aaa800a6f24c8e691ce188edeecec-7f810427ef2745c1861b4c28d9be69fb 2023-02-16 17:01:16,246 INFO [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] regionserver.HStore(310): Store=362aaa800a6f24c8e691ce188edeecec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:16,247 INFO [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:16,248 DEBUG [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2 2023-02-16 17:01:16,248 INFO [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 362aaa800a6f24c8e691ce188edeecec columnFamilyName f2 2023-02-16 17:01:16,254 DEBUG [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2/testWithMapReduce=362aaa800a6f24c8e691ce188edeecec-68a2107048944b64a6534d2ead37d591 2023-02-16 17:01:16,254 INFO [StoreOpener-362aaa800a6f24c8e691ce188edeecec-1] regionserver.HStore(310): Store=362aaa800a6f24c8e691ce188edeecec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:16,254 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:16,254 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 362aaa800a6f24c8e691ce188edeecec; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75018662, jitterRate=0.1178651750087738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:16,254 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 362aaa800a6f24c8e691ce188edeecec: 2023-02-16 17:01:16,296 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 362aaa800a6f24c8e691ce188edeecec, disabling compactions & flushes 2023-02-16 17:01:16,296 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:16,296 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:16,297 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. after waiting 0 ms 2023-02-16 17:01:16,297 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:16,300 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:16,300 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 362aaa800a6f24c8e691ce188edeecec: 2023-02-16 17:01:16,305 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:16,305 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:16,308 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:16,316 INFO [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:16,318 DEBUG [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1 2023-02-16 17:01:16,318 INFO [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dea97ec90688c064e4a226d52af25da0 columnFamilyName f1 2023-02-16 17:01:16,326 DEBUG [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1/testWithMapReduce=dea97ec90688c064e4a226d52af25da0-83df3764f99e40138b1f1339553da4a4 2023-02-16 17:01:16,326 INFO [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] regionserver.HStore(310): Store=dea97ec90688c064e4a226d52af25da0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:16,326 INFO [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:16,328 DEBUG [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2 2023-02-16 17:01:16,329 INFO [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dea97ec90688c064e4a226d52af25da0 columnFamilyName f2 2023-02-16 17:01:16,338 DEBUG [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2/testWithMapReduce=dea97ec90688c064e4a226d52af25da0-706ea5d3ca8a495faffdf03a326d5dfa 2023-02-16 17:01:16,339 INFO [StoreOpener-dea97ec90688c064e4a226d52af25da0-1] regionserver.HStore(310): Store=dea97ec90688c064e4a226d52af25da0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:16,339 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:16,339 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dea97ec90688c064e4a226d52af25da0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65465466, jitterRate=-0.02448853850364685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:16,339 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dea97ec90688c064e4a226d52af25da0: 2023-02-16 17:01:16,373 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dea97ec90688c064e4a226d52af25da0, disabling compactions & flushes 2023-02-16 17:01:16,373 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:16,373 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:16,373 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. after waiting 0 ms 2023-02-16 17:01:16,373 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:16,377 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:16,377 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dea97ec90688c064e4a226d52af25da0: 2023-02-16 17:01:16,384 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:16,384 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:16,387 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:16,392 INFO [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:16,393 DEBUG [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1 2023-02-16 17:01:16,394 INFO [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dba382119e74f3337a2e4dde935e21ed columnFamilyName f1 2023-02-16 17:01:16,401 DEBUG [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1/testWithMapReduce=dba382119e74f3337a2e4dde935e21ed-85ae5495c629477b85c58e8b95e1b76b 2023-02-16 17:01:16,401 INFO [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] regionserver.HStore(310): Store=dba382119e74f3337a2e4dde935e21ed/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:16,401 INFO [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:16,402 DEBUG [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2 2023-02-16 17:01:16,402 INFO [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dba382119e74f3337a2e4dde935e21ed columnFamilyName f2 2023-02-16 17:01:16,408 DEBUG [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2/testWithMapReduce=dba382119e74f3337a2e4dde935e21ed-96c5dfc366e5443fa7e99f4f29a5f9a2 2023-02-16 17:01:16,408 INFO [StoreOpener-dba382119e74f3337a2e4dde935e21ed-1] regionserver.HStore(310): Store=dba382119e74f3337a2e4dde935e21ed/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:16,408 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:16,408 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dba382119e74f3337a2e4dde935e21ed; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72540064, jitterRate=0.08093118667602539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:16,408 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dba382119e74f3337a2e4dde935e21ed: 2023-02-16 17:01:16,439 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dba382119e74f3337a2e4dde935e21ed, disabling compactions & flushes 2023-02-16 17:01:16,439 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:16,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:16,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. after waiting 0 ms 2023-02-16 17:01:16,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:16,443 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:16,444 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dba382119e74f3337a2e4dde935e21ed: 2023-02-16 17:01:16,449 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:16,450 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:16,453 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:16,456 INFO [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:16,458 DEBUG [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/f1 2023-02-16 17:01:16,459 INFO [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1a7443ba00bdedeceff74e5c3ff1dc4 columnFamilyName f1 2023-02-16 17:01:16,459 INFO [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] regionserver.HStore(310): Store=e1a7443ba00bdedeceff74e5c3ff1dc4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:16,460 INFO [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:16,464 DEBUG [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/f2 2023-02-16 17:01:16,465 INFO [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1a7443ba00bdedeceff74e5c3ff1dc4 columnFamilyName f2 2023-02-16 17:01:16,466 INFO [StoreOpener-e1a7443ba00bdedeceff74e5c3ff1dc4-1] regionserver.HStore(310): Store=e1a7443ba00bdedeceff74e5c3ff1dc4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:16,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:16,466 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e1a7443ba00bdedeceff74e5c3ff1dc4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61576430, jitterRate=-0.08243969082832336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:16,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e1a7443ba00bdedeceff74e5c3ff1dc4: 2023-02-16 17:01:16,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e1a7443ba00bdedeceff74e5c3ff1dc4, disabling compactions & flushes 2023-02-16 17:01:16,506 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:16,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:16,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. after waiting 0 ms 2023-02-16 17:01:16,506 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:16,507 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:16,507 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e1a7443ba00bdedeceff74e5c3ff1dc4: 2023-02-16 17:01:16,510 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:16,510 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:16,512 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:16,514 INFO [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:16,515 DEBUG [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1 2023-02-16 17:01:16,515 INFO [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0b64600fb3c2bef9100c7e97ba82991 columnFamilyName f1 2023-02-16 17:01:16,526 DEBUG [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1/testWithMapReduce=d0b64600fb3c2bef9100c7e97ba82991-e2a1dfc4705f4e32a6e23e3ee6efa399 2023-02-16 17:01:16,526 INFO [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] regionserver.HStore(310): Store=d0b64600fb3c2bef9100c7e97ba82991/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:16,526 INFO [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:16,527 DEBUG [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2 2023-02-16 17:01:16,528 INFO [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0b64600fb3c2bef9100c7e97ba82991 columnFamilyName f2 2023-02-16 17:01:16,534 DEBUG [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] regionserver.HStore(539): loaded hdfs://localhost:40299/user/jenkins/test-data/40d00dab-bc5f-0228-4325-9af50e4587c5/testWithMapReduceMultiRegion/62d2c1b4-edf5-4188-97dc-4ff1ad997758/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2/testWithMapReduce=d0b64600fb3c2bef9100c7e97ba82991-3ca17f53333e4867b2a20151e200927b 2023-02-16 17:01:16,534 INFO [StoreOpener-d0b64600fb3c2bef9100c7e97ba82991-1] regionserver.HStore(310): Store=d0b64600fb3c2bef9100c7e97ba82991/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:16,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:16,534 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d0b64600fb3c2bef9100c7e97ba82991; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63498175, jitterRate=-0.0538034588098526}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:16,534 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d0b64600fb3c2bef9100c7e97ba82991: 2023-02-16 17:01:16,567 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d0b64600fb3c2bef9100c7e97ba82991, disabling compactions & flushes 2023-02-16 17:01:16,567 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:16,567 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:16,567 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. after waiting 0 ms 2023-02-16 17:01:16,567 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:16,575 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:16,575 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d0b64600fb3c2bef9100c7e97ba82991: 2023-02-16 17:01:17,455 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-16 17:01:17,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-16 17:01:17,461 INFO [Listener at localhost/43373] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 17:01:17,462 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 17:01:17,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-16 17:01:17,472 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566877471"}]},"ts":"1676566877471"} 2023-02-16 17:01:17,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 17:01:17,474 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-16 17:01:17,477 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-16 17:01:17,481 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=24d6989912aa4c5c32a50fd8baf30fcc, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=362aaa800a6f24c8e691ce188edeecec, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=06fd504538972f7449bc0b3227fa4198, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3387c5fcea518e8693a59cfd54f1842e, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3a316f18bc36030ad711981973302817, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d0b64600fb3c2bef9100c7e97ba82991, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=dba382119e74f3337a2e4dde935e21ed, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8adbcab08ea9bcb78f6d7bee68684036, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=dea97ec90688c064e4a226d52af25da0, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e1a7443ba00bdedeceff74e5c3ff1dc4, UNASSIGN}] 2023-02-16 17:01:17,483 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e1a7443ba00bdedeceff74e5c3ff1dc4, UNASSIGN 2023-02-16 17:01:17,483 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8adbcab08ea9bcb78f6d7bee68684036, UNASSIGN 2023-02-16 17:01:17,483 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=dba382119e74f3337a2e4dde935e21ed, UNASSIGN 2023-02-16 17:01:17,483 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=dea97ec90688c064e4a226d52af25da0, UNASSIGN 2023-02-16 17:01:17,484 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e1a7443ba00bdedeceff74e5c3ff1dc4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:17,484 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=dea97ec90688c064e4a226d52af25da0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:17,485 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877484"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566877484"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566877484"}]},"ts":"1676566877484"} 2023-02-16 17:01:17,484 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=dba382119e74f3337a2e4dde935e21ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:17,484 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=8adbcab08ea9bcb78f6d7bee68684036, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:17,484 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566877484"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566877484"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566877484"}]},"ts":"1676566877484"} 2023-02-16 17:01:17,485 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877484"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566877484"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566877484"}]},"ts":"1676566877484"} 2023-02-16 17:01:17,485 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877484"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566877484"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566877484"}]},"ts":"1676566877484"} 2023-02-16 17:01:17,486 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d0b64600fb3c2bef9100c7e97ba82991, UNASSIGN 2023-02-16 17:01:17,487 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=d0b64600fb3c2bef9100c7e97ba82991, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:17,487 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566877487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566877487"}]},"ts":"1676566877487"} 2023-02-16 17:01:17,488 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=42, state=RUNNABLE; CloseRegionProcedure dea97ec90688c064e4a226d52af25da0, server=jenkins-hbase4.apache.org,34397,1676566863389}] 2023-02-16 17:01:17,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; CloseRegionProcedure e1a7443ba00bdedeceff74e5c3ff1dc4, server=jenkins-hbase4.apache.org,41601,1676566863467}] 2023-02-16 17:01:17,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=40, state=RUNNABLE; CloseRegionProcedure dba382119e74f3337a2e4dde935e21ed, server=jenkins-hbase4.apache.org,41601,1676566863467}] 2023-02-16 17:01:17,491 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=41, state=RUNNABLE; CloseRegionProcedure 8adbcab08ea9bcb78f6d7bee68684036, server=jenkins-hbase4.apache.org,34397,1676566863389}] 2023-02-16 17:01:17,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=39, state=RUNNABLE; CloseRegionProcedure d0b64600fb3c2bef9100c7e97ba82991, server=jenkins-hbase4.apache.org,41601,1676566863467}] 2023-02-16 17:01:17,499 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3a316f18bc36030ad711981973302817, UNASSIGN 2023-02-16 17:01:17,499 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3387c5fcea518e8693a59cfd54f1842e, UNASSIGN 2023-02-16 17:01:17,500 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=06fd504538972f7449bc0b3227fa4198, UNASSIGN 2023-02-16 17:01:17,500 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3387c5fcea518e8693a59cfd54f1842e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:17,500 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=362aaa800a6f24c8e691ce188edeecec, UNASSIGN 2023-02-16 17:01:17,501 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877500"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566877500"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566877500"}]},"ts":"1676566877500"} 2023-02-16 17:01:17,501 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=24d6989912aa4c5c32a50fd8baf30fcc, UNASSIGN 2023-02-16 17:01:17,501 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3a316f18bc36030ad711981973302817, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:17,501 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676566867448.3a316f18bc36030ad711981973302817.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877501"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566877501"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566877501"}]},"ts":"1676566877501"} 2023-02-16 17:01:17,502 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=06fd504538972f7449bc0b3227fa4198, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:17,502 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877502"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566877502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566877502"}]},"ts":"1676566877502"} 2023-02-16 17:01:17,503 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=362aaa800a6f24c8e691ce188edeecec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:17,503 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=24d6989912aa4c5c32a50fd8baf30fcc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:17,503 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877503"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566877503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566877503"}]},"ts":"1676566877503"} 2023-02-16 17:01:17,503 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566877503"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566877503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566877503"}]},"ts":"1676566877503"} 2023-02-16 17:01:17,505 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=37, state=RUNNABLE; CloseRegionProcedure 3387c5fcea518e8693a59cfd54f1842e, server=jenkins-hbase4.apache.org,34397,1676566863389}] 2023-02-16 17:01:17,505 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=38, state=RUNNABLE; CloseRegionProcedure 3a316f18bc36030ad711981973302817, server=jenkins-hbase4.apache.org,34397,1676566863389}] 2023-02-16 17:01:17,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure 06fd504538972f7449bc0b3227fa4198, server=jenkins-hbase4.apache.org,41601,1676566863467}] 2023-02-16 17:01:17,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 362aaa800a6f24c8e691ce188edeecec, server=jenkins-hbase4.apache.org,34397,1676566863389}] 2023-02-16 17:01:17,510 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 24d6989912aa4c5c32a50fd8baf30fcc, server=jenkins-hbase4.apache.org,41601,1676566863467}] 2023-02-16 17:01:17,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 17:01:17,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:17,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:17,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dea97ec90688c064e4a226d52af25da0, disabling compactions & flushes 2023-02-16 17:01:17,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 06fd504538972f7449bc0b3227fa4198, disabling compactions & flushes 2023-02-16 17:01:17,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:17,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:17,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:17,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:17,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. after waiting 0 ms 2023-02-16 17:01:17,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:17,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. after waiting 0 ms 2023-02-16 17:01:17,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:17,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:17,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:17,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198. 2023-02-16 17:01:17,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0. 2023-02-16 17:01:17,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 06fd504538972f7449bc0b3227fa4198: 2023-02-16 17:01:17,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dea97ec90688c064e4a226d52af25da0: 2023-02-16 17:01:17,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:17,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3a316f18bc36030ad711981973302817 2023-02-16 17:01:17,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3a316f18bc36030ad711981973302817, disabling compactions & flushes 2023-02-16 17:01:17,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:17,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:17,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. after waiting 0 ms 2023-02-16 17:01:17,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:17,665 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=dea97ec90688c064e4a226d52af25da0, regionState=CLOSED 2023-02-16 17:01:17,665 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566877665"}]},"ts":"1676566877665"} 2023-02-16 17:01:17,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:17,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:17,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 24d6989912aa4c5c32a50fd8baf30fcc, disabling compactions & flushes 2023-02-16 17:01:17,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:17,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:17,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. after waiting 0 ms 2023-02-16 17:01:17,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:17,667 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=06fd504538972f7449bc0b3227fa4198, regionState=CLOSED 2023-02-16 17:01:17,667 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877667"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566877667"}]},"ts":"1676566877667"} 2023-02-16 17:01:17,670 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-02-16 17:01:17,671 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; CloseRegionProcedure dea97ec90688c064e4a226d52af25da0, server=jenkins-hbase4.apache.org,34397,1676566863389 in 180 msec 2023-02-16 17:01:17,673 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-16 17:01:17,673 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure 06fd504538972f7449bc0b3227fa4198, server=jenkins-hbase4.apache.org,41601,1676566863467 in 162 msec 2023-02-16 17:01:17,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=06fd504538972f7449bc0b3227fa4198, UNASSIGN in 194 msec 2023-02-16 17:01:17,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dea97ec90688c064e4a226d52af25da0, UNASSIGN in 191 msec 2023-02-16 17:01:17,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 17:01:17,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:17,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc. 2023-02-16 17:01:17,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 24d6989912aa4c5c32a50fd8baf30fcc: 2023-02-16 17:01:17,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817. 2023-02-16 17:01:17,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3a316f18bc36030ad711981973302817: 2023-02-16 17:01:17,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:17,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:17,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d0b64600fb3c2bef9100c7e97ba82991, disabling compactions & flushes 2023-02-16 17:01:17,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:17,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:17,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. after waiting 0 ms 2023-02-16 17:01:17,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:17,681 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=24d6989912aa4c5c32a50fd8baf30fcc, regionState=CLOSED 2023-02-16 17:01:17,681 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566877681"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566877681"}]},"ts":"1676566877681"} 2023-02-16 17:01:17,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3a316f18bc36030ad711981973302817 2023-02-16 17:01:17,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:17,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8adbcab08ea9bcb78f6d7bee68684036, disabling compactions & flushes 2023-02-16 17:01:17,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:17,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:17,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. after waiting 0 ms 2023-02-16 17:01:17,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:17,684 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=3a316f18bc36030ad711981973302817, regionState=CLOSED 2023-02-16 17:01:17,684 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676566867448.3a316f18bc36030ad711981973302817.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566877684"}]},"ts":"1676566877684"} 2023-02-16 17:01:17,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-16 17:01:17,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 24d6989912aa4c5c32a50fd8baf30fcc, server=jenkins-hbase4.apache.org,41601,1676566863467 in 175 msec 2023-02-16 17:01:17,689 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=38 2023-02-16 17:01:17,689 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=24d6989912aa4c5c32a50fd8baf30fcc, UNASSIGN in 208 msec 2023-02-16 17:01:17,689 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=38, state=SUCCESS; CloseRegionProcedure 3a316f18bc36030ad711981973302817, server=jenkins-hbase4.apache.org,34397,1676566863389 in 181 msec 2023-02-16 17:01:17,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3a316f18bc36030ad711981973302817, UNASSIGN in 210 msec 2023-02-16 17:01:17,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:17,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:17,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991. 2023-02-16 17:01:17,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d0b64600fb3c2bef9100c7e97ba82991: 2023-02-16 17:01:17,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036. 2023-02-16 17:01:17,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8adbcab08ea9bcb78f6d7bee68684036: 2023-02-16 17:01:17,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:17,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:17,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e1a7443ba00bdedeceff74e5c3ff1dc4, disabling compactions & flushes 2023-02-16 17:01:17,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:17,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:17,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. after waiting 0 ms 2023-02-16 17:01:17,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:17,708 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=d0b64600fb3c2bef9100c7e97ba82991, regionState=CLOSED 2023-02-16 17:01:17,709 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877708"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566877708"}]},"ts":"1676566877708"} 2023-02-16 17:01:17,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:17,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:17,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 362aaa800a6f24c8e691ce188edeecec, disabling compactions & flushes 2023-02-16 17:01:17,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:17,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:17,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. after waiting 0 ms 2023-02-16 17:01:17,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:17,710 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=8adbcab08ea9bcb78f6d7bee68684036, regionState=CLOSED 2023-02-16 17:01:17,710 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877710"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566877710"}]},"ts":"1676566877710"} 2023-02-16 17:01:17,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 17:01:17,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=39 2023-02-16 17:01:17,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=39, state=SUCCESS; CloseRegionProcedure d0b64600fb3c2bef9100c7e97ba82991, server=jenkins-hbase4.apache.org,41601,1676566863467 in 219 msec 2023-02-16 17:01:17,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4. 2023-02-16 17:01:17,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e1a7443ba00bdedeceff74e5c3ff1dc4: 2023-02-16 17:01:17,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:17,717 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=41 2023-02-16 17:01:17,717 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=41, state=SUCCESS; CloseRegionProcedure 8adbcab08ea9bcb78f6d7bee68684036, server=jenkins-hbase4.apache.org,34397,1676566863389 in 221 msec 2023-02-16 17:01:17,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec. 2023-02-16 17:01:17,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 362aaa800a6f24c8e691ce188edeecec: 2023-02-16 17:01:17,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d0b64600fb3c2bef9100c7e97ba82991, UNASSIGN in 235 msec 2023-02-16 17:01:17,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:17,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:17,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dba382119e74f3337a2e4dde935e21ed, disabling compactions & flushes 2023-02-16 17:01:17,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:17,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:17,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. after waiting 0 ms 2023-02-16 17:01:17,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:17,723 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e1a7443ba00bdedeceff74e5c3ff1dc4, regionState=CLOSED 2023-02-16 17:01:17,723 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566877723"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566877723"}]},"ts":"1676566877723"} 2023-02-16 17:01:17,723 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8adbcab08ea9bcb78f6d7bee68684036, UNASSIGN in 238 msec 2023-02-16 17:01:17,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:17,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:17,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3387c5fcea518e8693a59cfd54f1842e, disabling compactions & flushes 2023-02-16 17:01:17,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:17,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:17,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. after waiting 0 ms 2023-02-16 17:01:17,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:17,724 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=362aaa800a6f24c8e691ce188edeecec, regionState=CLOSED 2023-02-16 17:01:17,724 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566877724"}]},"ts":"1676566877724"} 2023-02-16 17:01:17,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:17,729 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-02-16 17:01:17,729 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; CloseRegionProcedure e1a7443ba00bdedeceff74e5c3ff1dc4, server=jenkins-hbase4.apache.org,41601,1676566863467 in 236 msec 2023-02-16 17:01:17,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed. 2023-02-16 17:01:17,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dba382119e74f3337a2e4dde935e21ed: 2023-02-16 17:01:17,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:17,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-16 17:01:17,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 362aaa800a6f24c8e691ce188edeecec, server=jenkins-hbase4.apache.org,34397,1676566863389 in 218 msec 2023-02-16 17:01:17,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e. 2023-02-16 17:01:17,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3387c5fcea518e8693a59cfd54f1842e: 2023-02-16 17:01:17,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e1a7443ba00bdedeceff74e5c3ff1dc4, UNASSIGN in 249 msec 2023-02-16 17:01:17,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:17,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=362aaa800a6f24c8e691ce188edeecec, UNASSIGN in 253 msec 2023-02-16 17:01:17,734 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=dba382119e74f3337a2e4dde935e21ed, regionState=CLOSED 2023-02-16 17:01:17,734 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877734"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566877734"}]},"ts":"1676566877734"} 2023-02-16 17:01:17,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:17,736 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3387c5fcea518e8693a59cfd54f1842e, regionState=CLOSED 2023-02-16 17:01:17,736 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566877736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566877736"}]},"ts":"1676566877736"} 2023-02-16 17:01:17,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=40 2023-02-16 17:01:17,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=40, state=SUCCESS; CloseRegionProcedure dba382119e74f3337a2e4dde935e21ed, server=jenkins-hbase4.apache.org,41601,1676566863467 in 247 msec 2023-02-16 17:01:17,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=37 2023-02-16 17:01:17,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=37, state=SUCCESS; CloseRegionProcedure 3387c5fcea518e8693a59cfd54f1842e, server=jenkins-hbase4.apache.org,34397,1676566863389 in 232 msec 2023-02-16 17:01:17,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dba382119e74f3337a2e4dde935e21ed, UNASSIGN in 260 msec 2023-02-16 17:01:17,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=33 2023-02-16 17:01:17,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3387c5fcea518e8693a59cfd54f1842e, UNASSIGN in 261 msec 2023-02-16 17:01:17,743 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566877743"}]},"ts":"1676566877743"} 2023-02-16 17:01:17,745 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-16 17:01:17,747 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-16 17:01:17,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 284 msec 2023-02-16 17:01:17,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 17:01:17,778 INFO [Listener at localhost/43373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-16 17:01:17,782 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-16 17:01:17,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-16 17:01:17,790 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 17:01:17,792 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 17:01:17,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 17:01:17,806 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:17,806 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:17,806 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817 2023-02-16 17:01:17,806 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:17,806 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:17,806 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:17,806 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:17,806 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:17,811 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/recovered.edits] 2023-02-16 17:01:17,811 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/recovered.edits] 2023-02-16 17:01:17,811 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/f1, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/f2, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/recovered.edits] 2023-02-16 17:01:17,811 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/recovered.edits] 2023-02-16 17:01:17,811 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/recovered.edits] 2023-02-16 17:01:17,811 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/recovered.edits] 2023-02-16 17:01:17,812 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/recovered.edits] 2023-02-16 17:01:17,812 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/recovered.edits] 2023-02-16 17:01:17,823 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1/7f810427ef2745c1861b4c28d9be69fb to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1/7f810427ef2745c1861b4c28d9be69fb 2023-02-16 17:01:17,824 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1/0c2415f7016643d4b27bbf61721c69c8 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1/0c2415f7016643d4b27bbf61721c69c8 2023-02-16 17:01:17,824 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1/2052dd3f78964f43b3e88e7568de618b to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1/2052dd3f78964f43b3e88e7568de618b 2023-02-16 17:01:17,824 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1/2bb0f89e11624f2f88703c2bacc8eed2 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1/2bb0f89e11624f2f88703c2bacc8eed2 2023-02-16 17:01:17,824 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1/56d6de5d923a47e294fb1f74ef7a9fec to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1/56d6de5d923a47e294fb1f74ef7a9fec 2023-02-16 17:01:17,825 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1/6972a8c4d5b24a3198cce65efb80d568 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1/6972a8c4d5b24a3198cce65efb80d568 2023-02-16 17:01:17,825 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1/9cb8853bf4b349bcbb563ff6193ac336 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1/9cb8853bf4b349bcbb563ff6193ac336 2023-02-16 17:01:17,827 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/recovered.edits/6.seqid to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc/recovered.edits/6.seqid 2023-02-16 17:01:17,827 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1/f6e08e9dc6114c5ca1025655166b19ad to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f1/f6e08e9dc6114c5ca1025655166b19ad 2023-02-16 17:01:17,828 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1/eac61374bd374e85b7e53c00d1a2a77c to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f1/eac61374bd374e85b7e53c00d1a2a77c 2023-02-16 17:01:17,829 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/24d6989912aa4c5c32a50fd8baf30fcc 2023-02-16 17:01:17,829 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:17,829 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1/b5d9e055b37d4df7a91802ac3d9ab392 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f1/b5d9e055b37d4df7a91802ac3d9ab392 2023-02-16 17:01:17,829 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1/e2a1dfc4705f4e32a6e23e3ee6efa399 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f1/e2a1dfc4705f4e32a6e23e3ee6efa399 2023-02-16 17:01:17,829 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1/85ae5495c629477b85c58e8b95e1b76b to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f1/85ae5495c629477b85c58e8b95e1b76b 2023-02-16 17:01:17,830 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1/99d8bf02296844b8a5ebb96991675052 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f1/99d8bf02296844b8a5ebb96991675052 2023-02-16 17:01:17,830 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1/c41b20b6121e4da59aafc1d504b1131f to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f1/c41b20b6121e4da59aafc1d504b1131f 2023-02-16 17:01:17,833 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/recovered.edits] 2023-02-16 17:01:17,838 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2/96c5dfc366e5443fa7e99f4f29a5f9a2 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2/96c5dfc366e5443fa7e99f4f29a5f9a2 2023-02-16 17:01:17,838 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2/3686f9a2ca6b4c009dfae0dc91218302 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2/3686f9a2ca6b4c009dfae0dc91218302 2023-02-16 17:01:17,839 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2/e89451ac76204f5aa57fc2bf271a0813 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2/e89451ac76204f5aa57fc2bf271a0813 2023-02-16 17:01:17,839 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2/e83f91a78c1343f78fa2d1957f819843 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2/e83f91a78c1343f78fa2d1957f819843 2023-02-16 17:01:17,839 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2/9af61fc7ec054dffb736876779eb288f to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2/9af61fc7ec054dffb736876779eb288f 2023-02-16 17:01:17,840 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2/aa4e6e10d046430399fd1d2e108fca33 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2/aa4e6e10d046430399fd1d2e108fca33 2023-02-16 17:01:17,840 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2/3ca17f53333e4867b2a20151e200927b to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2/3ca17f53333e4867b2a20151e200927b 2023-02-16 17:01:17,842 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2/68a2107048944b64a6534d2ead37d591 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/f2/68a2107048944b64a6534d2ead37d591 2023-02-16 17:01:17,842 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2/f02ff7a921fe4421aad186d2a3bfd8af to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/f2/f02ff7a921fe4421aad186d2a3bfd8af 2023-02-16 17:01:17,842 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2/f27045d051c54685b09c7121c1e149af to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/f2/f27045d051c54685b09c7121c1e149af 2023-02-16 17:01:17,843 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2/f3cffff8d8ce407cab1ff35938e45194 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/f2/f3cffff8d8ce407cab1ff35938e45194 2023-02-16 17:01:17,843 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2/bb4fe2d9e6e5458e80a0f56af4af53a7 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/f2/bb4fe2d9e6e5458e80a0f56af4af53a7 2023-02-16 17:01:17,843 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2/fe2ba832587d43739c7a61bb2aac5a21 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/f2/fe2ba832587d43739c7a61bb2aac5a21 2023-02-16 17:01:17,844 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2/91e8235679834b73b60360dd2ed3c7fd to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/f2/91e8235679834b73b60360dd2ed3c7fd 2023-02-16 17:01:17,844 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1/7e36852e0d7b49ed8bf02f22dcd6b24f to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1/7e36852e0d7b49ed8bf02f22dcd6b24f 2023-02-16 17:01:17,847 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1/83df3764f99e40138b1f1339553da4a4 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f1/83df3764f99e40138b1f1339553da4a4 2023-02-16 17:01:17,849 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/recovered.edits/12.seqid to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec/recovered.edits/12.seqid 2023-02-16 17:01:17,849 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/recovered.edits/12.seqid to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed/recovered.edits/12.seqid 2023-02-16 17:01:17,850 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/recovered.edits/12.seqid to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817/recovered.edits/12.seqid 2023-02-16 17:01:17,850 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/362aaa800a6f24c8e691ce188edeecec 2023-02-16 17:01:17,851 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:17,851 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dba382119e74f3337a2e4dde935e21ed 2023-02-16 17:01:17,851 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3a316f18bc36030ad711981973302817 2023-02-16 17:01:17,851 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/recovered.edits/12.seqid to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e/recovered.edits/12.seqid 2023-02-16 17:01:17,852 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/recovered.edits/12.seqid to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036/recovered.edits/12.seqid 2023-02-16 17:01:17,852 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/recovered.edits/12.seqid to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991/recovered.edits/12.seqid 2023-02-16 17:01:17,852 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/recovered.edits/12.seqid to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198/recovered.edits/12.seqid 2023-02-16 17:01:17,853 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/3387c5fcea518e8693a59cfd54f1842e 2023-02-16 17:01:17,853 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/8adbcab08ea9bcb78f6d7bee68684036 2023-02-16 17:01:17,853 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/d0b64600fb3c2bef9100c7e97ba82991 2023-02-16 17:01:17,854 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/06fd504538972f7449bc0b3227fa4198 2023-02-16 17:01:17,854 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/f1, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/f2, FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/recovered.edits] 2023-02-16 17:01:17,855 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2/706ea5d3ca8a495faffdf03a326d5dfa to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2/706ea5d3ca8a495faffdf03a326d5dfa 2023-02-16 17:01:17,856 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2/ad8024c3b8f540a78de106bf7eb06577 to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/f2/ad8024c3b8f540a78de106bf7eb06577 2023-02-16 17:01:17,859 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/recovered.edits/12.seqid to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0/recovered.edits/12.seqid 2023-02-16 17:01:17,860 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/dea97ec90688c064e4a226d52af25da0 2023-02-16 17:01:17,861 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/recovered.edits/6.seqid to hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/archive/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4/recovered.edits/6.seqid 2023-02-16 17:01:17,861 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/.tmp/data/default/testWithMapReduce/e1a7443ba00bdedeceff74e5c3ff1dc4 2023-02-16 17:01:17,861 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 17:01:17,864 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 17:01:17,887 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-16 17:01:17,891 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-16 17:01:17,892 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 17:01:17,892 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-16 17:01:17,892 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566877892"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:17,892 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566877892"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:17,892 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566877892"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:17,892 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566877892"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:17,892 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676566867448.3a316f18bc36030ad711981973302817.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566877892"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:17,893 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566877892"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:17,893 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566877892"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:17,893 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566877892"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:17,893 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566877892"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:17,893 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566877892"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:17,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 17:01:17,895 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-16 17:01:17,895 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 24d6989912aa4c5c32a50fd8baf30fcc, NAME => 'testWithMapReduce,,1676566867448.24d6989912aa4c5c32a50fd8baf30fcc.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 362aaa800a6f24c8e691ce188edeecec, NAME => 'testWithMapReduce,aaa,1676566867448.362aaa800a6f24c8e691ce188edeecec.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 06fd504538972f7449bc0b3227fa4198, NAME => 'testWithMapReduce,d\x84\x84,1676566867448.06fd504538972f7449bc0b3227fa4198.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 3387c5fcea518e8693a59cfd54f1842e, NAME => 'testWithMapReduce,g\xA7\xA7,1676566867448.3387c5fcea518e8693a59cfd54f1842e.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 3a316f18bc36030ad711981973302817, NAME => 'testWithMapReduce,j\xCA\xCA,1676566867448.3a316f18bc36030ad711981973302817.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => d0b64600fb3c2bef9100c7e97ba82991, NAME => 'testWithMapReduce,m\xED\xED,1676566867448.d0b64600fb3c2bef9100c7e97ba82991.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => dba382119e74f3337a2e4dde935e21ed, NAME => 'testWithMapReduce,q\x11\x10,1676566867448.dba382119e74f3337a2e4dde935e21ed.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 8adbcab08ea9bcb78f6d7bee68684036, NAME => 'testWithMapReduce,t43,1676566867448.8adbcab08ea9bcb78f6d7bee68684036.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => dea97ec90688c064e4a226d52af25da0, NAME => 'testWithMapReduce,wWV,1676566867448.dea97ec90688c064e4a226d52af25da0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => e1a7443ba00bdedeceff74e5c3ff1dc4, NAME => 'testWithMapReduce,zz{,1676566867448.e1a7443ba00bdedeceff74e5c3ff1dc4.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-16 17:01:17,895 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-16 17:01:17,895 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676566877895"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:17,897 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-16 17:01:17,899 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 17:01:17,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 116 msec 2023-02-16 17:01:18,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40495] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 17:01:18,097 INFO [Listener at localhost/43373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-16 17:01:18,097 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 17:01:18,097 INFO [Listener at localhost/43373] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 17:01:18,097 DEBUG [Listener at localhost/43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x492f2b89 to 127.0.0.1:50419 2023-02-16 17:01:18,097 DEBUG [Listener at localhost/43373] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:18,097 DEBUG [Listener at localhost/43373] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 17:01:18,098 DEBUG [Listener at localhost/43373] util.JVMClusterUtil(257): Found active master hash=764365770, stopped=false 2023-02-16 17:01:18,098 INFO [Listener at localhost/43373] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40495,1676566862134 2023-02-16 17:01:18,101 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:18,102 INFO [Listener at localhost/43373] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 17:01:18,102 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:18,102 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:18,102 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:18,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:18,103 DEBUG [Listener at localhost/43373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x375d7a7e to 127.0.0.1:50419 2023-02-16 17:01:18,103 DEBUG [Listener at localhost/43373] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:18,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:18,103 INFO [Listener at localhost/43373] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34397,1676566863389' ***** 2023-02-16 17:01:18,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:18,103 INFO [Listener at localhost/43373] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:18,103 INFO [Listener at localhost/43373] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41601,1676566863467' ***** 2023-02-16 17:01:18,103 INFO [Listener at localhost/43373] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:18,104 INFO [RS:0;jenkins-hbase4:34397] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:18,104 INFO [RS:1;jenkins-hbase4:41601] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:18,104 INFO [RS:1;jenkins-hbase4:41601] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:18,104 INFO [RS:0;jenkins-hbase4:34397] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:18,104 INFO [RS:0;jenkins-hbase4:34397] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:18,104 INFO [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(3304): Received CLOSE for 12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:18,104 INFO [RS:1;jenkins-hbase4:41601] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:18,104 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:18,104 INFO [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:18,105 DEBUG [RS:1;jenkins-hbase4:41601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c983de1 to 127.0.0.1:50419 2023-02-16 17:01:18,105 DEBUG [RS:1;jenkins-hbase4:41601] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:18,105 INFO [RS:1;jenkins-hbase4:41601] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:18,105 INFO [RS:1;jenkins-hbase4:41601] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:18,105 INFO [RS:1;jenkins-hbase4:41601] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:18,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 12266b3361a4f74b5085bf05d1d5cbb2, disabling compactions & flushes 2023-02-16 17:01:18,104 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:18,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. 2023-02-16 17:01:18,106 INFO [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 17:01:18,105 INFO [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:18,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. 2023-02-16 17:01:18,106 DEBUG [RS:0;jenkins-hbase4:34397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e4bd4eb to 127.0.0.1:50419 2023-02-16 17:01:18,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. after waiting 0 ms 2023-02-16 17:01:18,106 DEBUG [RS:0;jenkins-hbase4:34397] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:18,106 INFO [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 17:01:18,107 INFO [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 17:01:18,107 DEBUG [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-16 17:01:18,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. 2023-02-16 17:01:18,107 DEBUG [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1479): Online Regions={12266b3361a4f74b5085bf05d1d5cbb2=hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2.} 2023-02-16 17:01:18,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 12266b3361a4f74b5085bf05d1d5cbb2 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 17:01:18,108 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:18,108 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:18,108 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:18,108 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:18,108 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:18,108 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-16 17:01:18,109 DEBUG [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1505): Waiting on 12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:18,109 DEBUG [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 17:01:18,121 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:18,121 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:18,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/.tmp/info/aeb418f62abc466c9b66b063f26822e3 2023-02-16 17:01:18,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aeb418f62abc466c9b66b063f26822e3 2023-02-16 17:01:18,174 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/.tmp/rep_barrier/24f24fc573f145efb902c498f661efd8 2023-02-16 17:01:18,182 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24f24fc573f145efb902c498f661efd8 2023-02-16 17:01:18,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/.tmp/table/ca1c8f1cbc284cee8a95d7ae12bf5d63 2023-02-16 17:01:18,210 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca1c8f1cbc284cee8a95d7ae12bf5d63 2023-02-16 17:01:18,211 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/.tmp/info/aeb418f62abc466c9b66b063f26822e3 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/info/aeb418f62abc466c9b66b063f26822e3 2023-02-16 17:01:18,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aeb418f62abc466c9b66b063f26822e3 2023-02-16 17:01:18,219 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/info/aeb418f62abc466c9b66b063f26822e3, entries=30, sequenceid=57, filesize=7.9 K 2023-02-16 17:01:18,220 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/.tmp/rep_barrier/24f24fc573f145efb902c498f661efd8 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/rep_barrier/24f24fc573f145efb902c498f661efd8 2023-02-16 17:01:18,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24f24fc573f145efb902c498f661efd8 2023-02-16 17:01:18,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/rep_barrier/24f24fc573f145efb902c498f661efd8, entries=10, sequenceid=57, filesize=5.9 K 2023-02-16 17:01:18,228 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/.tmp/table/ca1c8f1cbc284cee8a95d7ae12bf5d63 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/table/ca1c8f1cbc284cee8a95d7ae12bf5d63 2023-02-16 17:01:18,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca1c8f1cbc284cee8a95d7ae12bf5d63 2023-02-16 17:01:18,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/table/ca1c8f1cbc284cee8a95d7ae12bf5d63, entries=13, sequenceid=57, filesize=5.9 K 2023-02-16 17:01:18,236 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 128ms, sequenceid=57, compaction requested=false 2023-02-16 17:01:18,256 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-16 17:01:18,257 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 17:01:18,258 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:18,258 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:18,259 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:18,309 INFO [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41601,1676566863467; all regions closed. 2023-02-16 17:01:18,309 DEBUG [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1505): Waiting on 12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:18,317 DEBUG [RS:1;jenkins-hbase4:41601] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/oldWALs 2023-02-16 17:01:18,318 INFO [RS:1;jenkins-hbase4:41601] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41601%2C1676566863467.meta:.meta(num 1676566866187) 2023-02-16 17:01:18,323 DEBUG [RS:1;jenkins-hbase4:41601] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/oldWALs 2023-02-16 17:01:18,323 INFO [RS:1;jenkins-hbase4:41601] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41601%2C1676566863467:(num 1676566866853) 2023-02-16 17:01:18,324 DEBUG [RS:1;jenkins-hbase4:41601] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:18,324 INFO [RS:1;jenkins-hbase4:41601] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:18,324 INFO [RS:1;jenkins-hbase4:41601] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:18,324 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:18,325 INFO [RS:1;jenkins-hbase4:41601] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41601 2023-02-16 17:01:18,332 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:18,332 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:18,332 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:18,332 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41601,1676566863467 2023-02-16 17:01:18,333 ERROR [Listener at localhost/43373-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7564c87d rejected from java.util.concurrent.ThreadPoolExecutor@715b5209[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:18,333 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:18,333 ERROR [Listener at localhost/43373-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56534d45 rejected from java.util.concurrent.ThreadPoolExecutor@715b5209[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:18,334 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41601,1676566863467] 2023-02-16 17:01:18,334 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41601,1676566863467; numProcessing=1 2023-02-16 17:01:18,335 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41601,1676566863467 already deleted, retry=false 2023-02-16 17:01:18,335 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41601,1676566863467 expired; onlineServers=1 2023-02-16 17:01:18,510 DEBUG [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1505): Waiting on 12266b3361a4f74b5085bf05d1d5cbb2 2023-02-16 17:01:18,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2/.tmp/info/0a0f17aba95b47cebc00a5d14ce9f929 2023-02-16 17:01:18,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2/.tmp/info/0a0f17aba95b47cebc00a5d14ce9f929 as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2/info/0a0f17aba95b47cebc00a5d14ce9f929 2023-02-16 17:01:18,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2/info/0a0f17aba95b47cebc00a5d14ce9f929, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 17:01:18,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 12266b3361a4f74b5085bf05d1d5cbb2 in 442ms, sequenceid=6, compaction requested=false 2023-02-16 17:01:18,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/data/hbase/namespace/12266b3361a4f74b5085bf05d1d5cbb2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 17:01:18,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. 2023-02-16 17:01:18,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 12266b3361a4f74b5085bf05d1d5cbb2: 2023-02-16 17:01:18,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676566866525.12266b3361a4f74b5085bf05d1d5cbb2. 2023-02-16 17:01:18,605 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:18,605 INFO [RS:1;jenkins-hbase4:41601] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41601,1676566863467; zookeeper connection closed. 2023-02-16 17:01:18,605 ERROR [Listener at localhost/43373-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e478175 rejected from java.util.concurrent.ThreadPoolExecutor@715b5209[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:18,605 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:41601-0x1005e13ff5d0002, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:18,605 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1e6e94f7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1e6e94f7 2023-02-16 17:01:18,605 ERROR [Listener at localhost/43373-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@18036ba7 rejected from java.util.concurrent.ThreadPoolExecutor@715b5209[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:18,710 INFO [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34397,1676566863389; all regions closed. 2023-02-16 17:01:18,716 DEBUG [RS:0;jenkins-hbase4:34397] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/oldWALs 2023-02-16 17:01:18,716 INFO [RS:0;jenkins-hbase4:34397] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34397%2C1676566863389:(num 1676566866853) 2023-02-16 17:01:18,716 DEBUG [RS:0;jenkins-hbase4:34397] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:18,716 INFO [RS:0;jenkins-hbase4:34397] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:18,716 INFO [RS:0;jenkins-hbase4:34397] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:18,717 INFO [RS:0;jenkins-hbase4:34397] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:18,717 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:18,717 INFO [RS:0;jenkins-hbase4:34397] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:18,717 INFO [RS:0;jenkins-hbase4:34397] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:18,718 INFO [RS:0;jenkins-hbase4:34397] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34397 2023-02-16 17:01:18,722 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34397,1676566863389 2023-02-16 17:01:18,722 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:18,722 ERROR [Listener at localhost/43373-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@deb0f5c rejected from java.util.concurrent.ThreadPoolExecutor@9d49a39[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:18,723 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34397,1676566863389] 2023-02-16 17:01:18,723 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34397,1676566863389; numProcessing=2 2023-02-16 17:01:18,724 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34397,1676566863389 already deleted, retry=false 2023-02-16 17:01:18,724 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34397,1676566863389 expired; onlineServers=0 2023-02-16 17:01:18,724 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40495,1676566862134' ***** 2023-02-16 17:01:18,724 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 17:01:18,725 DEBUG [M:0;jenkins-hbase4:40495] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cb241f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:18,725 INFO [M:0;jenkins-hbase4:40495] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40495,1676566862134 2023-02-16 17:01:18,725 INFO [M:0;jenkins-hbase4:40495] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40495,1676566862134; all regions closed. 2023-02-16 17:01:18,725 DEBUG [M:0;jenkins-hbase4:40495] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:18,725 DEBUG [M:0;jenkins-hbase4:40495] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 17:01:18,725 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 17:01:18,725 DEBUG [M:0;jenkins-hbase4:40495] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 17:01:18,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566864693] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566864693,5,FailOnTimeoutGroup] 2023-02-16 17:01:18,726 INFO [M:0;jenkins-hbase4:40495] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 17:01:18,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566864690] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566864690,5,FailOnTimeoutGroup] 2023-02-16 17:01:18,727 INFO [M:0;jenkins-hbase4:40495] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 17:01:18,727 INFO [M:0;jenkins-hbase4:40495] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 17:01:18,727 DEBUG [M:0;jenkins-hbase4:40495] master.HMaster(1512): Stopping service threads 2023-02-16 17:01:18,727 INFO [M:0;jenkins-hbase4:40495] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 17:01:18,728 ERROR [M:0;jenkins-hbase4:40495] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 17:01:18,728 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] 2023-02-16 17:01:18,728 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-16 17:01:18,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:18,728 INFO [M:0;jenkins-hbase4:40495] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 17:01:18,728 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 17:01:18,729 DEBUG [M:0;jenkins-hbase4:40495] zookeeper.ZKUtil(398): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 17:01:18,729 WARN [M:0;jenkins-hbase4:40495] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 17:01:18,729 INFO [M:0;jenkins-hbase4:40495] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 17:01:18,730 INFO [M:0;jenkins-hbase4:40495] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 17:01:18,730 DEBUG [M:0;jenkins-hbase4:40495] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:18,730 INFO [M:0;jenkins-hbase4:40495] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:18,730 DEBUG [M:0;jenkins-hbase4:40495] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:18,730 DEBUG [M:0;jenkins-hbase4:40495] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:18,730 DEBUG [M:0;jenkins-hbase4:40495] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:18,730 INFO [M:0;jenkins-hbase4:40495] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.25 KB heapSize=192.19 KB 2023-02-16 17:01:18,753 INFO [M:0;jenkins-hbase4:40495] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.25 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/92d5a3f6491c4002bcdf8667d8360e8b 2023-02-16 17:01:18,759 DEBUG [M:0;jenkins-hbase4:40495] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/92d5a3f6491c4002bcdf8667d8360e8b as hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/92d5a3f6491c4002bcdf8667d8360e8b 2023-02-16 17:01:18,764 INFO [M:0;jenkins-hbase4:40495] regionserver.HStore(1080): Added hdfs://localhost:40299/user/jenkins/test-data/6bf92181-62cb-2d9e-b495-155133baa42c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/92d5a3f6491c4002bcdf8667d8360e8b, entries=53, sequenceid=357, filesize=10.4 K 2023-02-16 17:01:18,765 INFO [M:0;jenkins-hbase4:40495] regionserver.HRegion(2947): Finished flush of dataSize ~159.25 KB/163075, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 35ms, sequenceid=357, compaction requested=false 2023-02-16 17:01:18,787 INFO [M:0;jenkins-hbase4:40495] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:18,787 DEBUG [M:0;jenkins-hbase4:40495] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:18,792 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:18,792 INFO [M:0;jenkins-hbase4:40495] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 17:01:18,793 INFO [M:0;jenkins-hbase4:40495] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40495 2023-02-16 17:01:18,799 DEBUG [M:0;jenkins-hbase4:40495] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40495,1676566862134 already deleted, retry=false 2023-02-16 17:01:18,823 INFO [RS:0;jenkins-hbase4:34397] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34397,1676566863389; zookeeper connection closed. 2023-02-16 17:01:18,823 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:18,823 ERROR [Listener at localhost/43373-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2814030d rejected from java.util.concurrent.ThreadPoolExecutor@9d49a39[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:18,824 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4328e7ab] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4328e7ab 2023-02-16 17:01:18,824 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): regionserver:34397-0x1005e13ff5d0001, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:18,824 ERROR [Listener at localhost/43373-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5078307d rejected from java.util.concurrent.ThreadPoolExecutor@9d49a39[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:18,824 INFO [Listener at localhost/43373] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 17:01:18,923 INFO [M:0;jenkins-hbase4:40495] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40495,1676566862134; zookeeper connection closed. 2023-02-16 17:01:18,924 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:18,924 ERROR [Listener at localhost/43373-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1452f90 rejected from java.util.concurrent.ThreadPoolExecutor@1a1a442b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:18,924 DEBUG [Listener at localhost/43373-EventThread] zookeeper.ZKWatcher(600): master:40495-0x1005e13ff5d0000, quorum=127.0.0.1:50419, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:18,924 ERROR [Listener at localhost/43373-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@617c0d28 rejected from java.util.concurrent.ThreadPoolExecutor@1a1a442b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:18,926 WARN [Listener at localhost/43373] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:18,948 INFO [Listener at localhost/43373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:18,990 WARN [BP-71860560-172.31.14.131-1676566858537 heartbeating to localhost/127.0.0.1:40299] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-71860560-172.31.14.131-1676566858537 (Datanode Uuid 7e67da74-6bbc-4acd-837b-979ff532293a) service to localhost/127.0.0.1:40299 2023-02-16 17:01:18,991 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/cluster_aa4ed667-b63b-e045-1ed5-982b85dea6e2/dfs/data/data3/current/BP-71860560-172.31.14.131-1676566858537] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:18,992 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/cluster_aa4ed667-b63b-e045-1ed5-982b85dea6e2/dfs/data/data4/current/BP-71860560-172.31.14.131-1676566858537] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:19,055 WARN [Listener at localhost/43373] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:19,058 INFO [Listener at localhost/43373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:19,161 WARN [BP-71860560-172.31.14.131-1676566858537 heartbeating to localhost/127.0.0.1:40299] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 17:01:19,162 WARN [BP-71860560-172.31.14.131-1676566858537 heartbeating to localhost/127.0.0.1:40299] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-71860560-172.31.14.131-1676566858537 (Datanode Uuid 4d02dc30-043b-431d-b7bc-e56e8fb45b4e) service to localhost/127.0.0.1:40299 2023-02-16 17:01:19,162 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/cluster_aa4ed667-b63b-e045-1ed5-982b85dea6e2/dfs/data/data1/current/BP-71860560-172.31.14.131-1676566858537] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:19,163 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/cluster_aa4ed667-b63b-e045-1ed5-982b85dea6e2/dfs/data/data2/current/BP-71860560-172.31.14.131-1676566858537] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:19,201 INFO [Listener at localhost/43373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:19,330 INFO [Listener at localhost/43373] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 17:01:19,399 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 17:01:19,413 INFO [Listener at localhost/43373] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=103 (was 7) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:40299 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:40299 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43373 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40299 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:40299 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40495,1676566862134)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:40299 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:40299 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@4b027040 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:40299 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=533 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=249 (was 163) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=1980 (was 3593) 2023-02-16 17:01:19,422 INFO [Listener at localhost/43373] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=103, OpenFileDescriptor=533, MaxFileDescriptor=60000, SystemLoadAverage=249, ProcessCount=169, AvailableMemoryMB=1980 2023-02-16 17:01:19,434 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/hadoop.log.dir so I do NOT create it in target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37 2023-02-16 17:01:19,435 WARN [Listener at localhost/43373] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 17:01:19,435 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/hadoop.tmp.dir so I do NOT create it in target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37 2023-02-16 17:01:19,435 WARN [Listener at localhost/43373] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aeeeef53-f717-4dba-4e0e-d4daddc9a243/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 17:01:19,435 DEBUG [Listener at localhost/43373] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37 2023-02-16 17:01:19,435 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 17:01:19,435 INFO [Listener at localhost/43373] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/cluster_b2e49a4e-844a-74af-ab1f-6b345802eb22, deleteOnExit=true 2023-02-16 17:01:19,435 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 17:01:19,435 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/test.cache.data in system properties and HBase conf 2023-02-16 17:01:19,435 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 17:01:19,435 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/hadoop.log.dir in system properties and HBase conf 2023-02-16 17:01:19,436 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 17:01:19,436 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 17:01:19,436 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 17:01:19,436 DEBUG [Listener at localhost/43373] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 17:01:19,436 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:01:19,436 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:01:19,436 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 17:01:19,436 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:01:19,437 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 17:01:19,437 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 17:01:19,437 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:01:19,437 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:01:19,437 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 17:01:19,437 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/nfs.dump.dir in system properties and HBase conf 2023-02-16 17:01:19,437 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/java.io.tmpdir in system properties and HBase conf 2023-02-16 17:01:19,437 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:01:19,437 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 17:01:19,437 INFO [Listener at localhost/43373] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 17:01:19,442 WARN [Listener at localhost/43373] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:01:19,442 WARN [Listener at localhost/43373] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:01:19,492 WARN [Listener at localhost/43373] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:19,495 INFO [Listener at localhost/43373] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:19,503 INFO [Listener at localhost/43373] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/java.io.tmpdir/Jetty_localhost_43107_hdfs____p37mbn/webapp 2023-02-16 17:01:19,609 INFO [Listener at localhost/43373] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43107 2023-02-16 17:01:19,614 WARN [Listener at localhost/43373] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:01:19,614 WARN [Listener at localhost/43373] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:01:19,662 WARN [Listener at localhost/41429] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:19,684 WARN [Listener at localhost/41429] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:19,686 WARN [Listener at localhost/41429] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:19,688 INFO [Listener at localhost/41429] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:19,698 INFO [Listener at localhost/41429] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/java.io.tmpdir/Jetty_localhost_33357_datanode____zhfmzg/webapp 2023-02-16 17:01:19,802 INFO [Listener at localhost/41429] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33357 2023-02-16 17:01:19,811 WARN [Listener at localhost/44277] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:19,831 WARN [Listener at localhost/44277] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:19,833 WARN [Listener at localhost/44277] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:19,834 INFO [Listener at localhost/44277] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:19,838 INFO [Listener at localhost/44277] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/java.io.tmpdir/Jetty_localhost_39845_datanode____.eie32e/webapp 2023-02-16 17:01:19,921 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfc655d07e3ed1604: Processing first storage report for DS-ba00f558-f868-4a4d-a67f-99e79795db8b from datanode a31600f4-efb5-4e45-8fb2-8bb1da65ec84 2023-02-16 17:01:19,921 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfc655d07e3ed1604: from storage DS-ba00f558-f868-4a4d-a67f-99e79795db8b node DatanodeRegistration(127.0.0.1:43075, datanodeUuid=a31600f4-efb5-4e45-8fb2-8bb1da65ec84, infoPort=33733, infoSecurePort=0, ipcPort=44277, storageInfo=lv=-57;cid=testClusterID;nsid=2076776044;c=1676566879445), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:19,921 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfc655d07e3ed1604: Processing first storage report for DS-cd29f216-3779-4750-82cd-6799dccad437 from datanode a31600f4-efb5-4e45-8fb2-8bb1da65ec84 2023-02-16 17:01:19,921 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfc655d07e3ed1604: from storage DS-cd29f216-3779-4750-82cd-6799dccad437 node DatanodeRegistration(127.0.0.1:43075, datanodeUuid=a31600f4-efb5-4e45-8fb2-8bb1da65ec84, infoPort=33733, infoSecurePort=0, ipcPort=44277, storageInfo=lv=-57;cid=testClusterID;nsid=2076776044;c=1676566879445), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:19,944 INFO [Listener at localhost/44277] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39845 2023-02-16 17:01:19,956 WARN [Listener at localhost/41389] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:20,073 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcc81cfc22b21fd9d: Processing first storage report for DS-954787f5-a91d-437d-b80d-22dbf19cd763 from datanode 8298649d-f274-46ab-b7dd-17c61ecad3b5 2023-02-16 17:01:20,073 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcc81cfc22b21fd9d: from storage DS-954787f5-a91d-437d-b80d-22dbf19cd763 node DatanodeRegistration(127.0.0.1:43467, datanodeUuid=8298649d-f274-46ab-b7dd-17c61ecad3b5, infoPort=33407, infoSecurePort=0, ipcPort=41389, storageInfo=lv=-57;cid=testClusterID;nsid=2076776044;c=1676566879445), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:20,073 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcc81cfc22b21fd9d: Processing first storage report for DS-39707a61-95e7-4fc8-aa6b-0c3937259427 from datanode 8298649d-f274-46ab-b7dd-17c61ecad3b5 2023-02-16 17:01:20,073 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcc81cfc22b21fd9d: from storage DS-39707a61-95e7-4fc8-aa6b-0c3937259427 node DatanodeRegistration(127.0.0.1:43467, datanodeUuid=8298649d-f274-46ab-b7dd-17c61ecad3b5, infoPort=33407, infoSecurePort=0, ipcPort=41389, storageInfo=lv=-57;cid=testClusterID;nsid=2076776044;c=1676566879445), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:20,169 DEBUG [Listener at localhost/41389] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37 2023-02-16 17:01:20,173 INFO [Listener at localhost/41389] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/cluster_b2e49a4e-844a-74af-ab1f-6b345802eb22/zookeeper_0, clientPort=54475, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/cluster_b2e49a4e-844a-74af-ab1f-6b345802eb22/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/cluster_b2e49a4e-844a-74af-ab1f-6b345802eb22/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 17:01:20,176 INFO [Listener at localhost/41389] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54475 2023-02-16 17:01:20,177 INFO [Listener at localhost/41389] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:20,178 INFO [Listener at localhost/41389] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:20,200 INFO [Listener at localhost/41389] util.FSUtils(479): Created version file at hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f with version=8 2023-02-16 17:01:20,200 INFO [Listener at localhost/41389] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:20,202 INFO [Listener at localhost/41389] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:20,203 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/hbase-staging 2023-02-16 17:01:20,205 INFO [Listener at localhost/41389] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:20,205 INFO [Listener at localhost/41389] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:20,206 INFO [Listener at localhost/41389] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:20,206 INFO [Listener at localhost/41389] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:20,206 INFO [Listener at localhost/41389] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:20,206 INFO [Listener at localhost/41389] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:20,206 INFO [Listener at localhost/41389] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:20,208 INFO [Listener at localhost/41389] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38729 2023-02-16 17:01:20,209 INFO [Listener at localhost/41389] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:20,210 INFO [Listener at localhost/41389] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:20,211 INFO [Listener at localhost/41389] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38729 connecting to ZooKeeper ensemble=127.0.0.1:54475 2023-02-16 17:01:20,222 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:387290x0, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:20,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38729-0x1005e1449710000 connected 2023-02-16 17:01:20,252 DEBUG [Listener at localhost/41389] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:20,253 DEBUG [Listener at localhost/41389] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:20,253 DEBUG [Listener at localhost/41389] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:20,257 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38729 2023-02-16 17:01:20,257 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38729 2023-02-16 17:01:20,257 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38729 2023-02-16 17:01:20,260 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38729 2023-02-16 17:01:20,260 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38729 2023-02-16 17:01:20,260 INFO [Listener at localhost/41389] master.HMaster(444): hbase.rootdir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f, hbase.cluster.distributed=false 2023-02-16 17:01:20,278 INFO [Listener at localhost/41389] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:20,278 INFO [Listener at localhost/41389] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:20,278 INFO [Listener at localhost/41389] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:20,279 INFO [Listener at localhost/41389] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:20,279 INFO [Listener at localhost/41389] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:20,279 INFO [Listener at localhost/41389] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:20,279 INFO [Listener at localhost/41389] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:20,282 INFO [Listener at localhost/41389] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37759 2023-02-16 17:01:20,283 INFO [Listener at localhost/41389] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:20,288 DEBUG [Listener at localhost/41389] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:20,289 INFO [Listener at localhost/41389] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:20,291 INFO [Listener at localhost/41389] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:20,292 INFO [Listener at localhost/41389] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37759 connecting to ZooKeeper ensemble=127.0.0.1:54475 2023-02-16 17:01:20,296 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:377590x0, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:20,297 DEBUG [Listener at localhost/41389] zookeeper.ZKUtil(164): regionserver:377590x0, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:20,298 DEBUG [Listener at localhost/41389] zookeeper.ZKUtil(164): regionserver:377590x0, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:20,298 DEBUG [Listener at localhost/41389] zookeeper.ZKUtil(164): regionserver:377590x0, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:20,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37759-0x1005e1449710001 connected 2023-02-16 17:01:20,304 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37759 2023-02-16 17:01:20,304 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37759 2023-02-16 17:01:20,305 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37759 2023-02-16 17:01:20,309 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37759 2023-02-16 17:01:20,309 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37759 2023-02-16 17:01:20,324 INFO [Listener at localhost/41389] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:20,324 INFO [Listener at localhost/41389] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:20,324 INFO [Listener at localhost/41389] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:20,324 INFO [Listener at localhost/41389] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:20,324 INFO [Listener at localhost/41389] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:20,324 INFO [Listener at localhost/41389] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:20,324 INFO [Listener at localhost/41389] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:20,326 INFO [Listener at localhost/41389] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46395 2023-02-16 17:01:20,326 INFO [Listener at localhost/41389] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:20,327 DEBUG [Listener at localhost/41389] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:20,328 INFO [Listener at localhost/41389] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:20,329 INFO [Listener at localhost/41389] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:20,330 INFO [Listener at localhost/41389] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46395 connecting to ZooKeeper ensemble=127.0.0.1:54475 2023-02-16 17:01:20,334 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:463950x0, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:20,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46395-0x1005e1449710002 connected 2023-02-16 17:01:20,335 DEBUG [Listener at localhost/41389] zookeeper.ZKUtil(164): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:20,336 DEBUG [Listener at localhost/41389] zookeeper.ZKUtil(164): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:20,336 DEBUG [Listener at localhost/41389] zookeeper.ZKUtil(164): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:20,345 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46395 2023-02-16 17:01:20,346 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46395 2023-02-16 17:01:20,346 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46395 2023-02-16 17:01:20,347 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46395 2023-02-16 17:01:20,348 DEBUG [Listener at localhost/41389] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46395 2023-02-16 17:01:20,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38729,1676566880205 2023-02-16 17:01:20,352 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:20,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38729,1676566880205 2023-02-16 17:01:20,354 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:20,354 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:20,354 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:20,355 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:20,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:20,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:20,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38729,1676566880205 from backup master directory 2023-02-16 17:01:20,358 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38729,1676566880205 2023-02-16 17:01:20,358 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:20,358 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:20,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38729,1676566880205 2023-02-16 17:01:20,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/hbase.id with ID: a46bdbfa-043b-42d7-bf3f-2f1cda9cb1fa 2023-02-16 17:01:20,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:20,388 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:20,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x37f0aa88 to 127.0.0.1:54475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:20,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cf17d8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:20,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:20,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 17:01:20,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:20,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/data/master/store-tmp 2023-02-16 17:01:20,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:20,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:20,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:20,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:20,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:20,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:20,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:20,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:20,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/WALs/jenkins-hbase4.apache.org,38729,1676566880205 2023-02-16 17:01:20,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38729%2C1676566880205, suffix=, logDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/WALs/jenkins-hbase4.apache.org,38729,1676566880205, archiveDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/oldWALs, maxLogs=10 2023-02-16 17:01:20,445 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43467,DS-954787f5-a91d-437d-b80d-22dbf19cd763,DISK] 2023-02-16 17:01:20,447 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43075,DS-ba00f558-f868-4a4d-a67f-99e79795db8b,DISK] 2023-02-16 17:01:20,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/WALs/jenkins-hbase4.apache.org,38729,1676566880205/jenkins-hbase4.apache.org%2C38729%2C1676566880205.1676566880423 2023-02-16 17:01:20,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43467,DS-954787f5-a91d-437d-b80d-22dbf19cd763,DISK], DatanodeInfoWithStorage[127.0.0.1:43075,DS-ba00f558-f868-4a4d-a67f-99e79795db8b,DISK]] 2023-02-16 17:01:20,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:20,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:20,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:20,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:20,453 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:20,455 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 17:01:20,455 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 17:01:20,456 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:20,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:20,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:20,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:20,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:20,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61705307, jitterRate=-0.08051927387714386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:20,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:20,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 17:01:20,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 17:01:20,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 17:01:20,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 17:01:20,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 17:01:20,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 17:01:20,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 17:01:20,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 17:01:20,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 17:01:20,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 17:01:20,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 17:01:20,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 17:01:20,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 17:01:20,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 17:01:20,488 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:20,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 17:01:20,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 17:01:20,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 17:01:20,492 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:20,492 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:20,492 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:20,492 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:20,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38729,1676566880205, sessionid=0x1005e1449710000, setting cluster-up flag (Was=false) 2023-02-16 17:01:20,498 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:20,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 17:01:20,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38729,1676566880205 2023-02-16 17:01:20,508 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:20,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 17:01:20,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38729,1676566880205 2023-02-16 17:01:20,517 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.hbase-snapshot/.tmp 2023-02-16 17:01:20,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:20,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:20,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:20,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:20,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:20,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 17:01:20,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:20,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676566910526 2023-02-16 17:01:20,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 17:01:20,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 17:01:20,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 17:01:20,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 17:01:20,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 17:01:20,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 17:01:20,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,531 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:20,531 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 17:01:20,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 17:01:20,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 17:01:20,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 17:01:20,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 17:01:20,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 17:01:20,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566880533,5,FailOnTimeoutGroup] 2023-02-16 17:01:20,533 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:20,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566880533,5,FailOnTimeoutGroup] 2023-02-16 17:01:20,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 17:01:20,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,551 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(952): ClusterId : a46bdbfa-043b-42d7-bf3f-2f1cda9cb1fa 2023-02-16 17:01:20,551 DEBUG [RS:1;jenkins-hbase4:46395] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:20,551 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(952): ClusterId : a46bdbfa-043b-42d7-bf3f-2f1cda9cb1fa 2023-02-16 17:01:20,551 DEBUG [RS:0;jenkins-hbase4:37759] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:20,553 DEBUG [RS:1;jenkins-hbase4:46395] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:20,553 DEBUG [RS:1;jenkins-hbase4:46395] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:20,556 DEBUG [RS:0;jenkins-hbase4:37759] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:20,556 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:20,556 DEBUG [RS:0;jenkins-hbase4:37759] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:20,556 DEBUG [RS:1;jenkins-hbase4:46395] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:20,557 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:20,558 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f 2023-02-16 17:01:20,558 DEBUG [RS:1;jenkins-hbase4:46395] zookeeper.ReadOnlyZKClient(139): Connect 0x33d2fd4e to 127.0.0.1:54475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:20,561 DEBUG [RS:0;jenkins-hbase4:37759] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:20,562 DEBUG [RS:0;jenkins-hbase4:37759] zookeeper.ReadOnlyZKClient(139): Connect 0x3c87b8ab to 127.0.0.1:54475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:20,568 DEBUG [RS:1;jenkins-hbase4:46395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d151544, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:20,569 DEBUG [RS:1;jenkins-hbase4:46395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@392a963e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:20,577 DEBUG [RS:0;jenkins-hbase4:37759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3240514b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:20,577 DEBUG [RS:0;jenkins-hbase4:37759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@367fd3db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:20,583 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:20,584 DEBUG [RS:1;jenkins-hbase4:46395] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46395 2023-02-16 17:01:20,584 INFO [RS:1;jenkins-hbase4:46395] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:20,584 INFO [RS:1;jenkins-hbase4:46395] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:20,584 DEBUG [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:20,585 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38729,1676566880205 with isa=jenkins-hbase4.apache.org/172.31.14.131:46395, startcode=1676566880323 2023-02-16 17:01:20,585 DEBUG [RS:1;jenkins-hbase4:46395] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:20,588 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:20,590 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58563, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:20,591 DEBUG [RS:0;jenkins-hbase4:37759] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37759 2023-02-16 17:01:20,591 INFO [RS:0;jenkins-hbase4:37759] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:20,591 INFO [RS:0;jenkins-hbase4:37759] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:20,591 DEBUG [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:20,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:20,593 DEBUG [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f 2023-02-16 17:01:20,593 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38729,1676566880205 with isa=jenkins-hbase4.apache.org/172.31.14.131:37759, startcode=1676566880278 2023-02-16 17:01:20,593 DEBUG [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41429 2023-02-16 17:01:20,593 DEBUG [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:20,593 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/info 2023-02-16 17:01:20,593 DEBUG [RS:0;jenkins-hbase4:37759] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:20,593 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:20,595 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:20,595 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:20,596 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:20,597 DEBUG [RS:1;jenkins-hbase4:46395] zookeeper.ZKUtil(162): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:20,597 WARN [RS:1;jenkins-hbase4:46395] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:20,597 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:20,597 INFO [RS:1;jenkins-hbase4:46395] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:20,597 DEBUG [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/WALs/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:20,598 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:20,598 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:20,599 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:20,601 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/table 2023-02-16 17:01:20,601 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:20,602 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:20,625 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740 2023-02-16 17:01:20,626 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58867, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:20,626 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46395,1676566880323] 2023-02-16 17:01:20,626 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740 2023-02-16 17:01:20,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:20,628 DEBUG [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f 2023-02-16 17:01:20,628 DEBUG [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41429 2023-02-16 17:01:20,628 DEBUG [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:20,630 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:20,631 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:20,635 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:20,635 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:20,635 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:20,635 DEBUG [RS:1;jenkins-hbase4:46395] zookeeper.ZKUtil(162): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:20,635 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60572894, jitterRate=-0.09739354252815247}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:20,635 DEBUG [RS:0;jenkins-hbase4:37759] zookeeper.ZKUtil(162): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:20,635 WARN [RS:0;jenkins-hbase4:37759] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:20,636 INFO [RS:0;jenkins-hbase4:37759] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:20,635 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37759,1676566880278] 2023-02-16 17:01:20,636 DEBUG [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/WALs/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:20,635 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:20,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:20,636 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:20,636 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:20,636 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:20,636 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:20,636 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:20,636 DEBUG [RS:1;jenkins-hbase4:46395] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:20,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:20,636 INFO [RS:1;jenkins-hbase4:46395] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:20,638 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:20,638 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:20,640 INFO [RS:1;jenkins-hbase4:46395] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:20,640 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:20,640 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 17:01:20,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 17:01:20,640 DEBUG [RS:0;jenkins-hbase4:37759] zookeeper.ZKUtil(162): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:20,641 DEBUG [RS:0;jenkins-hbase4:37759] zookeeper.ZKUtil(162): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:20,643 DEBUG [RS:0;jenkins-hbase4:37759] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:20,643 INFO [RS:0;jenkins-hbase4:37759] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:20,644 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 17:01:20,644 INFO [RS:1;jenkins-hbase4:46395] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:20,645 INFO [RS:1;jenkins-hbase4:46395] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,645 INFO [RS:0;jenkins-hbase4:37759] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:20,646 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 17:01:20,647 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:20,647 INFO [RS:0;jenkins-hbase4:37759] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:20,648 INFO [RS:0;jenkins-hbase4:37759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,648 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:20,648 INFO [RS:1;jenkins-hbase4:46395] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,649 DEBUG [RS:1;jenkins-hbase4:46395] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:1;jenkins-hbase4:46395] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:1;jenkins-hbase4:46395] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:1;jenkins-hbase4:46395] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:1;jenkins-hbase4:46395] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:1;jenkins-hbase4:46395] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:20,649 INFO [RS:0;jenkins-hbase4:37759] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,649 DEBUG [RS:1;jenkins-hbase4:46395] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:1;jenkins-hbase4:46395] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:0;jenkins-hbase4:37759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:1;jenkins-hbase4:46395] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:0;jenkins-hbase4:37759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:1;jenkins-hbase4:46395] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:0;jenkins-hbase4:37759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:0;jenkins-hbase4:37759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:0;jenkins-hbase4:37759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,649 DEBUG [RS:0;jenkins-hbase4:37759] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:20,650 DEBUG [RS:0;jenkins-hbase4:37759] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,650 DEBUG [RS:0;jenkins-hbase4:37759] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,650 DEBUG [RS:0;jenkins-hbase4:37759] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,650 DEBUG [RS:0;jenkins-hbase4:37759] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:20,651 INFO [RS:1;jenkins-hbase4:46395] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,651 INFO [RS:1;jenkins-hbase4:46395] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,651 INFO [RS:0;jenkins-hbase4:37759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,651 INFO [RS:1;jenkins-hbase4:46395] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,651 INFO [RS:0;jenkins-hbase4:37759] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,651 INFO [RS:0;jenkins-hbase4:37759] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,663 INFO [RS:0;jenkins-hbase4:37759] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:20,663 INFO [RS:1;jenkins-hbase4:46395] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:20,663 INFO [RS:0;jenkins-hbase4:37759] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37759,1676566880278-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,663 INFO [RS:1;jenkins-hbase4:46395] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46395,1676566880323-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:20,676 INFO [RS:1;jenkins-hbase4:46395] regionserver.Replication(203): jenkins-hbase4.apache.org,46395,1676566880323 started 2023-02-16 17:01:20,676 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46395,1676566880323, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46395, sessionid=0x1005e1449710002 2023-02-16 17:01:20,676 INFO [RS:0;jenkins-hbase4:37759] regionserver.Replication(203): jenkins-hbase4.apache.org,37759,1676566880278 started 2023-02-16 17:01:20,676 DEBUG [RS:1;jenkins-hbase4:46395] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:20,676 DEBUG [RS:1;jenkins-hbase4:46395] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:20,676 DEBUG [RS:1;jenkins-hbase4:46395] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46395,1676566880323' 2023-02-16 17:01:20,676 DEBUG [RS:1;jenkins-hbase4:46395] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:20,676 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37759,1676566880278, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37759, sessionid=0x1005e1449710001 2023-02-16 17:01:20,676 DEBUG [RS:0;jenkins-hbase4:37759] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:20,676 DEBUG [RS:0;jenkins-hbase4:37759] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:20,676 DEBUG [RS:0;jenkins-hbase4:37759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37759,1676566880278' 2023-02-16 17:01:20,676 DEBUG [RS:0;jenkins-hbase4:37759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:20,677 DEBUG [RS:1;jenkins-hbase4:46395] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:20,677 DEBUG [RS:0;jenkins-hbase4:37759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:20,677 DEBUG [RS:1;jenkins-hbase4:46395] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:20,677 DEBUG [RS:0;jenkins-hbase4:37759] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:20,677 DEBUG [RS:0;jenkins-hbase4:37759] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:20,677 DEBUG [RS:1;jenkins-hbase4:46395] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:20,677 DEBUG [RS:1;jenkins-hbase4:46395] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:20,677 DEBUG [RS:1;jenkins-hbase4:46395] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46395,1676566880323' 2023-02-16 17:01:20,677 DEBUG [RS:1;jenkins-hbase4:46395] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:20,677 DEBUG [RS:0;jenkins-hbase4:37759] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:20,677 DEBUG [RS:0;jenkins-hbase4:37759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37759,1676566880278' 2023-02-16 17:01:20,677 DEBUG [RS:0;jenkins-hbase4:37759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:20,678 DEBUG [RS:1;jenkins-hbase4:46395] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:20,678 DEBUG [RS:0;jenkins-hbase4:37759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:20,678 DEBUG [RS:1;jenkins-hbase4:46395] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:20,678 INFO [RS:1;jenkins-hbase4:46395] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:20,678 INFO [RS:1;jenkins-hbase4:46395] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:20,678 DEBUG [RS:0;jenkins-hbase4:37759] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:20,678 INFO [RS:0;jenkins-hbase4:37759] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:20,678 INFO [RS:0;jenkins-hbase4:37759] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:20,797 DEBUG [jenkins-hbase4:38729] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 17:01:20,797 DEBUG [jenkins-hbase4:38729] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:20,799 DEBUG [jenkins-hbase4:38729] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:20,799 DEBUG [jenkins-hbase4:38729] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:20,799 DEBUG [jenkins-hbase4:38729] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:20,801 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37759,1676566880278, state=OPENING 2023-02-16 17:01:20,802 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 17:01:20,803 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:20,804 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:20,804 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37759,1676566880278}] 2023-02-16 17:01:20,958 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:20,958 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:20,961 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40740, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:20,965 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 17:01:20,965 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:20,967 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37759%2C1676566880278.meta, suffix=.meta, logDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/WALs/jenkins-hbase4.apache.org,37759,1676566880278, archiveDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/oldWALs, maxLogs=32 2023-02-16 17:01:20,986 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43075,DS-ba00f558-f868-4a4d-a67f-99e79795db8b,DISK] 2023-02-16 17:01:20,987 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43467,DS-954787f5-a91d-437d-b80d-22dbf19cd763,DISK] 2023-02-16 17:01:20,990 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/WALs/jenkins-hbase4.apache.org,37759,1676566880278/jenkins-hbase4.apache.org%2C37759%2C1676566880278.meta.1676566880968.meta 2023-02-16 17:01:20,990 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43075,DS-ba00f558-f868-4a4d-a67f-99e79795db8b,DISK], DatanodeInfoWithStorage[127.0.0.1:43467,DS-954787f5-a91d-437d-b80d-22dbf19cd763,DISK]] 2023-02-16 17:01:20,991 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:20,991 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 17:01:20,991 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 17:01:20,992 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 17:01:20,992 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 17:01:20,992 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:20,992 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 17:01:20,992 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 17:01:20,996 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:20,997 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/info 2023-02-16 17:01:20,997 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/info 2023-02-16 17:01:20,997 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:20,998 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:20,998 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:20,999 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:20,999 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:20,999 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:21,000 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:21,000 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:21,001 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/table 2023-02-16 17:01:21,001 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/table 2023-02-16 17:01:21,001 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:21,002 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:21,003 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740 2023-02-16 17:01:21,003 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740 2023-02-16 17:01:21,005 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:21,006 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:21,007 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59884198, jitterRate=-0.10765591263771057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:21,007 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:21,008 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676566880958 2023-02-16 17:01:21,012 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 17:01:21,012 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 17:01:21,013 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37759,1676566880278, state=OPEN 2023-02-16 17:01:21,014 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 17:01:21,014 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:21,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 17:01:21,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37759,1676566880278 in 210 msec 2023-02-16 17:01:21,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 17:01:21,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 377 msec 2023-02-16 17:01:21,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 502 msec 2023-02-16 17:01:21,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676566881030, completionTime=-1 2023-02-16 17:01:21,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 17:01:21,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 17:01:21,038 DEBUG [hconnection-0x6478d19c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:21,041 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40746, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:21,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 17:01:21,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676566941043 2023-02-16 17:01:21,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676567001044 2023-02-16 17:01:21,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 13 msec 2023-02-16 17:01:21,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38729,1676566880205-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:21,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38729,1676566880205-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:21,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38729,1676566880205-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:21,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38729, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:21,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:21,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 17:01:21,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:21,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 17:01:21,082 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:21,083 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:21,089 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341 2023-02-16 17:01:21,090 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341 empty. 2023-02-16 17:01:21,091 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341 2023-02-16 17:01:21,091 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 17:01:21,092 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 17:01:21,112 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:21,114 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6567dfb5c531077caa73552d43ebe341, NAME => 'hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp 2023-02-16 17:01:21,135 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:21,135 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 6567dfb5c531077caa73552d43ebe341, disabling compactions & flushes 2023-02-16 17:01:21,135 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. 2023-02-16 17:01:21,135 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. 2023-02-16 17:01:21,135 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. after waiting 0 ms 2023-02-16 17:01:21,135 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. 2023-02-16 17:01:21,135 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. 2023-02-16 17:01:21,136 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 6567dfb5c531077caa73552d43ebe341: 2023-02-16 17:01:21,139 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:21,141 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566881141"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566881141"}]},"ts":"1676566881141"} 2023-02-16 17:01:21,145 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 17:01:21,146 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:21,146 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566881146"}]},"ts":"1676566881146"} 2023-02-16 17:01:21,148 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 17:01:21,152 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:21,153 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:21,153 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:21,153 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:21,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6567dfb5c531077caa73552d43ebe341, ASSIGN}] 2023-02-16 17:01:21,156 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6567dfb5c531077caa73552d43ebe341, ASSIGN 2023-02-16 17:01:21,157 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6567dfb5c531077caa73552d43ebe341, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37759,1676566880278; forceNewPlan=false, retain=false 2023-02-16 17:01:21,307 INFO [jenkins-hbase4:38729] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 17:01:21,308 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6567dfb5c531077caa73552d43ebe341, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:21,309 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566881308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566881308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566881308"}]},"ts":"1676566881308"} 2023-02-16 17:01:21,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6567dfb5c531077caa73552d43ebe341, server=jenkins-hbase4.apache.org,37759,1676566880278}] 2023-02-16 17:01:21,470 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. 2023-02-16 17:01:21,473 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37759%2C1676566880278, suffix=, logDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/WALs/jenkins-hbase4.apache.org,37759,1676566880278, archiveDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/oldWALs, maxLogs=32 2023-02-16 17:01:21,497 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43075,DS-ba00f558-f868-4a4d-a67f-99e79795db8b,DISK] 2023-02-16 17:01:21,497 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43467,DS-954787f5-a91d-437d-b80d-22dbf19cd763,DISK] 2023-02-16 17:01:21,500 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/WALs/jenkins-hbase4.apache.org,37759,1676566880278/jenkins-hbase4.apache.org%2C37759%2C1676566880278.1676566881474 2023-02-16 17:01:21,500 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43467,DS-954787f5-a91d-437d-b80d-22dbf19cd763,DISK], DatanodeInfoWithStorage[127.0.0.1:43075,DS-ba00f558-f868-4a4d-a67f-99e79795db8b,DISK]] 2023-02-16 17:01:21,500 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6567dfb5c531077caa73552d43ebe341, NAME => 'hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:21,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6567dfb5c531077caa73552d43ebe341 2023-02-16 17:01:21,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:21,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6567dfb5c531077caa73552d43ebe341 2023-02-16 17:01:21,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6567dfb5c531077caa73552d43ebe341 2023-02-16 17:01:21,506 INFO [StoreOpener-6567dfb5c531077caa73552d43ebe341-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6567dfb5c531077caa73552d43ebe341 2023-02-16 17:01:21,507 DEBUG [StoreOpener-6567dfb5c531077caa73552d43ebe341-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341/info 2023-02-16 17:01:21,508 DEBUG [StoreOpener-6567dfb5c531077caa73552d43ebe341-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341/info 2023-02-16 17:01:21,508 INFO [StoreOpener-6567dfb5c531077caa73552d43ebe341-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6567dfb5c531077caa73552d43ebe341 columnFamilyName info 2023-02-16 17:01:21,509 INFO [StoreOpener-6567dfb5c531077caa73552d43ebe341-1] regionserver.HStore(310): Store=6567dfb5c531077caa73552d43ebe341/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:21,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341 2023-02-16 17:01:21,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341 2023-02-16 17:01:21,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6567dfb5c531077caa73552d43ebe341 2023-02-16 17:01:21,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:21,525 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6567dfb5c531077caa73552d43ebe341; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68847574, jitterRate=0.02590879797935486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:21,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6567dfb5c531077caa73552d43ebe341: 2023-02-16 17:01:21,527 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341., pid=6, masterSystemTime=1676566881464 2023-02-16 17:01:21,531 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6567dfb5c531077caa73552d43ebe341, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:21,531 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566881530"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566881530"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566881530"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566881530"}]},"ts":"1676566881530"} 2023-02-16 17:01:21,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. 2023-02-16 17:01:21,532 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. 2023-02-16 17:01:21,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 17:01:21,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6567dfb5c531077caa73552d43ebe341, server=jenkins-hbase4.apache.org,37759,1676566880278 in 222 msec 2023-02-16 17:01:21,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 17:01:21,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6567dfb5c531077caa73552d43ebe341, ASSIGN in 384 msec 2023-02-16 17:01:21,541 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:21,541 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566881541"}]},"ts":"1676566881541"} 2023-02-16 17:01:21,543 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 17:01:21,546 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:21,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 486 msec 2023-02-16 17:01:21,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 17:01:21,567 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:21,567 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:21,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 17:01:21,587 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:21,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 16 msec 2023-02-16 17:01:21,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 17:01:21,606 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:21,609 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-16 17:01:21,621 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 17:01:21,625 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 17:01:21,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.267sec 2023-02-16 17:01:21,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 17:01:21,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 17:01:21,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 17:01:21,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38729,1676566880205-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 17:01:21,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38729,1676566880205-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 17:01:21,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 17:01:21,651 DEBUG [Listener at localhost/41389] zookeeper.ReadOnlyZKClient(139): Connect 0x7a3e6541 to 127.0.0.1:54475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:21,656 DEBUG [Listener at localhost/41389] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e296248, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:21,660 DEBUG [hconnection-0x67678bc4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:21,664 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40762, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:21,666 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38729,1676566880205 2023-02-16 17:01:21,667 DEBUG [Listener at localhost/41389] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 17:01:21,669 DEBUG [Listener at localhost/41389] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 17:01:21,671 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58556, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 17:01:21,672 INFO [Listener at localhost/41389] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 17:01:21,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 17:01:21,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 17:01:21,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:58556 deadline: 1676566941672, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 17:01:21,673 INFO [Listener at localhost/41389] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 17:01:21,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:21,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 17:01:21,680 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:21,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 17:01:21,681 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:21,682 INFO [RS:1;jenkins-hbase4:46395] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46395%2C1676566880323, suffix=, logDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/WALs/jenkins-hbase4.apache.org,46395,1676566880323, archiveDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/oldWALs, maxLogs=32 2023-02-16 17:01:21,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:21,698 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:21,698 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:21,698 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:21,698 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:21,698 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:21,698 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:21,699 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222 empty. 2023-02-16 17:01:21,698 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be 2023-02-16 17:01:21,698 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017 2023-02-16 17:01:21,699 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8 empty. 2023-02-16 17:01:21,699 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e empty. 2023-02-16 17:01:21,699 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb empty. 2023-02-16 17:01:21,701 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be empty. 2023-02-16 17:01:21,703 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee empty. 2023-02-16 17:01:21,703 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e empty. 2023-02-16 17:01:21,703 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:21,703 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:21,703 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:21,703 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:21,704 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:21,704 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017 empty. 2023-02-16 17:01:21,704 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7 empty. 2023-02-16 17:01:21,704 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca empty. 2023-02-16 17:01:21,705 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:21,705 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:21,705 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017 2023-02-16 17:01:21,705 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be 2023-02-16 17:01:21,705 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:21,705 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:21,705 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:21,705 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 17:01:21,709 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43467,DS-954787f5-a91d-437d-b80d-22dbf19cd763,DISK] 2023-02-16 17:01:21,710 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43075,DS-ba00f558-f868-4a4d-a67f-99e79795db8b,DISK] 2023-02-16 17:01:21,716 INFO [RS:1;jenkins-hbase4:46395] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/WALs/jenkins-hbase4.apache.org,46395,1676566880323/jenkins-hbase4.apache.org%2C46395%2C1676566880323.1676566881683 2023-02-16 17:01:21,716 DEBUG [RS:1;jenkins-hbase4:46395] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43467,DS-954787f5-a91d-437d-b80d-22dbf19cd763,DISK], DatanodeInfoWithStorage[127.0.0.1:43075,DS-ba00f558-f868-4a4d-a67f-99e79795db8b,DISK]] 2023-02-16 17:01:21,723 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:21,726 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4023075ec5bc920cad48017303aae017, NAME => 'testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp 2023-02-16 17:01:21,726 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 875bff390fe68884baf037b513d266be, NAME => 'testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp 2023-02-16 17:01:21,726 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => aca79748b01eee0631c3c829c9d22222, NAME => 'testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp 2023-02-16 17:01:21,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:21,811 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:21,811 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4023075ec5bc920cad48017303aae017, disabling compactions & flushes 2023-02-16 17:01:21,811 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:21,811 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:21,811 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. after waiting 0 ms 2023-02-16 17:01:21,811 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:21,811 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:21,811 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4023075ec5bc920cad48017303aae017: 2023-02-16 17:01:21,812 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e95d77046c122a566664ad82ef7297cb, NAME => 'testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp 2023-02-16 17:01:21,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:21,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing aca79748b01eee0631c3c829c9d22222, disabling compactions & flushes 2023-02-16 17:01:21,815 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:21,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:21,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. after waiting 0 ms 2023-02-16 17:01:21,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:21,815 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:21,815 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for aca79748b01eee0631c3c829c9d22222: 2023-02-16 17:01:21,815 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => ad1324f80ea4b890ddd8023ad0f192ee, NAME => 'testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp 2023-02-16 17:01:21,820 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:21,821 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:21,821 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e95d77046c122a566664ad82ef7297cb, disabling compactions & flushes 2023-02-16 17:01:21,821 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 875bff390fe68884baf037b513d266be, disabling compactions & flushes 2023-02-16 17:01:21,821 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:21,821 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:21,821 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. after waiting 0 ms 2023-02-16 17:01:21,821 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:21,821 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:21,821 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. after waiting 0 ms 2023-02-16 17:01:21,821 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:21,821 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:21,821 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 875bff390fe68884baf037b513d266be: 2023-02-16 17:01:21,822 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 58e5e6c9f4fc62b6d822876844eb0bb8, NAME => 'testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp 2023-02-16 17:01:21,821 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:21,822 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:21,822 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e95d77046c122a566664ad82ef7297cb: 2023-02-16 17:01:21,823 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 58032a9cabb92e3926c24738e77cb25e, NAME => 'testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp 2023-02-16 17:01:21,836 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:21,836 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing ad1324f80ea4b890ddd8023ad0f192ee, disabling compactions & flushes 2023-02-16 17:01:21,836 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:21,836 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:21,836 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. after waiting 0 ms 2023-02-16 17:01:21,836 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:21,836 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:21,836 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for ad1324f80ea4b890ddd8023ad0f192ee: 2023-02-16 17:01:21,837 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3e2d3fd9abcc8caa75c6e93ce27d935e, NAME => 'testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp 2023-02-16 17:01:21,840 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:21,840 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 58032a9cabb92e3926c24738e77cb25e, disabling compactions & flushes 2023-02-16 17:01:21,840 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:21,840 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:21,840 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. after waiting 0 ms 2023-02-16 17:01:21,840 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:21,841 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:21,841 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 58032a9cabb92e3926c24738e77cb25e: 2023-02-16 17:01:21,841 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7276e6cb858090b97da96b3cd2751ce7, NAME => 'testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp 2023-02-16 17:01:21,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:21,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 3e2d3fd9abcc8caa75c6e93ce27d935e, disabling compactions & flushes 2023-02-16 17:01:21,861 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:21,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:21,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. after waiting 0 ms 2023-02-16 17:01:21,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:21,861 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:21,861 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 3e2d3fd9abcc8caa75c6e93ce27d935e: 2023-02-16 17:01:21,862 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 188a18d4a83aa31efed57f073fc3c3ca, NAME => 'testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.tmp 2023-02-16 17:01:21,873 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:21,873 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 7276e6cb858090b97da96b3cd2751ce7, disabling compactions & flushes 2023-02-16 17:01:21,873 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:21,873 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:21,873 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. after waiting 0 ms 2023-02-16 17:01:21,873 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:21,873 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:21,873 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 7276e6cb858090b97da96b3cd2751ce7: 2023-02-16 17:01:21,878 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:21,879 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 188a18d4a83aa31efed57f073fc3c3ca, disabling compactions & flushes 2023-02-16 17:01:21,879 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:21,879 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:21,879 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. after waiting 0 ms 2023-02-16 17:01:21,879 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:21,879 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:21,879 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 188a18d4a83aa31efed57f073fc3c3ca: 2023-02-16 17:01:22,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:22,245 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:22,245 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 58e5e6c9f4fc62b6d822876844eb0bb8, disabling compactions & flushes 2023-02-16 17:01:22,245 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:22,245 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:22,245 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. after waiting 0 ms 2023-02-16 17:01:22,245 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:22,245 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:22,245 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 58e5e6c9f4fc62b6d822876844eb0bb8: 2023-02-16 17:01:22,247 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:22,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566882248"}]},"ts":"1676566882248"} 2023-02-16 17:01:22,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566882248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566882248"}]},"ts":"1676566882248"} 2023-02-16 17:01:22,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676566881676.875bff390fe68884baf037b513d266be.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566882248"}]},"ts":"1676566882248"} 2023-02-16 17:01:22,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566882248"}]},"ts":"1676566882248"} 2023-02-16 17:01:22,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566882248"}]},"ts":"1676566882248"} 2023-02-16 17:01:22,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566882248"}]},"ts":"1676566882248"} 2023-02-16 17:01:22,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566882248"}]},"ts":"1676566882248"} 2023-02-16 17:01:22,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566882248"}]},"ts":"1676566882248"} 2023-02-16 17:01:22,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566882248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566882248"}]},"ts":"1676566882248"} 2023-02-16 17:01:22,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566882248"}]},"ts":"1676566882248"} 2023-02-16 17:01:22,252 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 17:01:22,253 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:22,253 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566882253"}]},"ts":"1676566882253"} 2023-02-16 17:01:22,255 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 17:01:22,258 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:22,265 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:22,265 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:22,265 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:22,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=aca79748b01eee0631c3c829c9d22222, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4023075ec5bc920cad48017303aae017, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=875bff390fe68884baf037b513d266be, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e95d77046c122a566664ad82ef7297cb, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ad1324f80ea4b890ddd8023ad0f192ee, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=58e5e6c9f4fc62b6d822876844eb0bb8, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=58032a9cabb92e3926c24738e77cb25e, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3e2d3fd9abcc8caa75c6e93ce27d935e, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7276e6cb858090b97da96b3cd2751ce7, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=188a18d4a83aa31efed57f073fc3c3ca, ASSIGN}] 2023-02-16 17:01:22,268 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7276e6cb858090b97da96b3cd2751ce7, ASSIGN 2023-02-16 17:01:22,268 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=188a18d4a83aa31efed57f073fc3c3ca, ASSIGN 2023-02-16 17:01:22,268 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3e2d3fd9abcc8caa75c6e93ce27d935e, ASSIGN 2023-02-16 17:01:22,268 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=58032a9cabb92e3926c24738e77cb25e, ASSIGN 2023-02-16 17:01:22,269 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=58e5e6c9f4fc62b6d822876844eb0bb8, ASSIGN 2023-02-16 17:01:22,269 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=188a18d4a83aa31efed57f073fc3c3ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37759,1676566880278; forceNewPlan=false, retain=false 2023-02-16 17:01:22,269 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7276e6cb858090b97da96b3cd2751ce7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46395,1676566880323; forceNewPlan=false, retain=false 2023-02-16 17:01:22,269 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=58032a9cabb92e3926c24738e77cb25e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46395,1676566880323; forceNewPlan=false, retain=false 2023-02-16 17:01:22,269 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3e2d3fd9abcc8caa75c6e93ce27d935e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37759,1676566880278; forceNewPlan=false, retain=false 2023-02-16 17:01:22,270 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=58e5e6c9f4fc62b6d822876844eb0bb8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46395,1676566880323; forceNewPlan=false, retain=false 2023-02-16 17:01:22,270 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ad1324f80ea4b890ddd8023ad0f192ee, ASSIGN 2023-02-16 17:01:22,270 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e95d77046c122a566664ad82ef7297cb, ASSIGN 2023-02-16 17:01:22,270 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=875bff390fe68884baf037b513d266be, ASSIGN 2023-02-16 17:01:22,270 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4023075ec5bc920cad48017303aae017, ASSIGN 2023-02-16 17:01:22,275 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=aca79748b01eee0631c3c829c9d22222, ASSIGN 2023-02-16 17:01:22,275 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ad1324f80ea4b890ddd8023ad0f192ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37759,1676566880278; forceNewPlan=false, retain=false 2023-02-16 17:01:22,275 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4023075ec5bc920cad48017303aae017, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37759,1676566880278; forceNewPlan=false, retain=false 2023-02-16 17:01:22,275 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=875bff390fe68884baf037b513d266be, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37759,1676566880278; forceNewPlan=false, retain=false 2023-02-16 17:01:22,275 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e95d77046c122a566664ad82ef7297cb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46395,1676566880323; forceNewPlan=false, retain=false 2023-02-16 17:01:22,276 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=aca79748b01eee0631c3c829c9d22222, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46395,1676566880323; forceNewPlan=false, retain=false 2023-02-16 17:01:22,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:22,419 INFO [jenkins-hbase4:38729] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 17:01:22,423 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7276e6cb858090b97da96b3cd2751ce7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:22,423 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e95d77046c122a566664ad82ef7297cb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:22,423 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aca79748b01eee0631c3c829c9d22222, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:22,423 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=58e5e6c9f4fc62b6d822876844eb0bb8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:22,424 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882423"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566882423"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566882423"}]},"ts":"1676566882423"} 2023-02-16 17:01:22,423 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=58032a9cabb92e3926c24738e77cb25e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:22,424 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882423"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566882423"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566882423"}]},"ts":"1676566882423"} 2023-02-16 17:01:22,424 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566882423"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566882423"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566882423"}]},"ts":"1676566882423"} 2023-02-16 17:01:22,424 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882423"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566882423"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566882423"}]},"ts":"1676566882423"} 2023-02-16 17:01:22,424 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882423"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566882423"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566882423"}]},"ts":"1676566882423"} 2023-02-16 17:01:22,426 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure 7276e6cb858090b97da96b3cd2751ce7, server=jenkins-hbase4.apache.org,46395,1676566880323}] 2023-02-16 17:01:22,427 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 58e5e6c9f4fc62b6d822876844eb0bb8, server=jenkins-hbase4.apache.org,46395,1676566880323}] 2023-02-16 17:01:22,428 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure aca79748b01eee0631c3c829c9d22222, server=jenkins-hbase4.apache.org,46395,1676566880323}] 2023-02-16 17:01:22,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=14, state=RUNNABLE; OpenRegionProcedure e95d77046c122a566664ad82ef7297cb, server=jenkins-hbase4.apache.org,46395,1676566880323}] 2023-02-16 17:01:22,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure 58032a9cabb92e3926c24738e77cb25e, server=jenkins-hbase4.apache.org,46395,1676566880323}] 2023-02-16 17:01:22,432 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ad1324f80ea4b890ddd8023ad0f192ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:22,432 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566882432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566882432"}]},"ts":"1676566882432"} 2023-02-16 17:01:22,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=188a18d4a83aa31efed57f073fc3c3ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:22,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566882432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566882432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566882432"}]},"ts":"1676566882432"} 2023-02-16 17:01:22,433 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3e2d3fd9abcc8caa75c6e93ce27d935e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:22,434 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566882433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566882433"}]},"ts":"1676566882433"} 2023-02-16 17:01:22,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure ad1324f80ea4b890ddd8023ad0f192ee, server=jenkins-hbase4.apache.org,37759,1676566880278}] 2023-02-16 17:01:22,437 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=4023075ec5bc920cad48017303aae017, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:22,437 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566882437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566882437"}]},"ts":"1676566882437"} 2023-02-16 17:01:22,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure 188a18d4a83aa31efed57f073fc3c3ca, server=jenkins-hbase4.apache.org,37759,1676566880278}] 2023-02-16 17:01:22,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 3e2d3fd9abcc8caa75c6e93ce27d935e, server=jenkins-hbase4.apache.org,37759,1676566880278}] 2023-02-16 17:01:22,439 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=12, state=RUNNABLE; OpenRegionProcedure 4023075ec5bc920cad48017303aae017, server=jenkins-hbase4.apache.org,37759,1676566880278}] 2023-02-16 17:01:22,447 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=875bff390fe68884baf037b513d266be, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:22,447 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676566881676.875bff390fe68884baf037b513d266be.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882447"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566882447"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566882447"}]},"ts":"1676566882447"} 2023-02-16 17:01:22,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure 875bff390fe68884baf037b513d266be, server=jenkins-hbase4.apache.org,37759,1676566880278}] 2023-02-16 17:01:22,579 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:22,579 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:22,582 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52020, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:22,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:22,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7276e6cb858090b97da96b3cd2751ce7, NAME => 'testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 17:01:22,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:22,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:22,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:22,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:22,588 INFO [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:22,589 DEBUG [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f1 2023-02-16 17:01:22,589 DEBUG [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f1 2023-02-16 17:01:22,589 INFO [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7276e6cb858090b97da96b3cd2751ce7 columnFamilyName f1 2023-02-16 17:01:22,590 INFO [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] regionserver.HStore(310): Store=7276e6cb858090b97da96b3cd2751ce7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,590 INFO [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:22,591 DEBUG [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f2 2023-02-16 17:01:22,591 DEBUG [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f2 2023-02-16 17:01:22,592 INFO [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7276e6cb858090b97da96b3cd2751ce7 columnFamilyName f2 2023-02-16 17:01:22,592 INFO [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] regionserver.HStore(310): Store=7276e6cb858090b97da96b3cd2751ce7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:22,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:22,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:22,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:22,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:22,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7276e6cb858090b97da96b3cd2751ce7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67903721, jitterRate=0.011844292283058167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:22,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7276e6cb858090b97da96b3cd2751ce7: 2023-02-16 17:01:22,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7., pid=21, masterSystemTime=1676566882579 2023-02-16 17:01:22,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:22,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 875bff390fe68884baf037b513d266be, NAME => 'testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 17:01:22,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 875bff390fe68884baf037b513d266be 2023-02-16 17:01:22,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:22,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 875bff390fe68884baf037b513d266be 2023-02-16 17:01:22,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 875bff390fe68884baf037b513d266be 2023-02-16 17:01:22,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:22,606 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7276e6cb858090b97da96b3cd2751ce7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:22,606 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882606"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566882606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566882606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566882606"}]},"ts":"1676566882606"} 2023-02-16 17:01:22,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:22,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:22,616 INFO [StoreOpener-875bff390fe68884baf037b513d266be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 875bff390fe68884baf037b513d266be 2023-02-16 17:01:22,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e95d77046c122a566664ad82ef7297cb, NAME => 'testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 17:01:22,617 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-16 17:01:22,617 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure 7276e6cb858090b97da96b3cd2751ce7, server=jenkins-hbase4.apache.org,46395,1676566880323 in 182 msec 2023-02-16 17:01:22,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:22,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:22,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:22,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:22,619 INFO [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:22,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7276e6cb858090b97da96b3cd2751ce7, ASSIGN in 352 msec 2023-02-16 17:01:22,619 DEBUG [StoreOpener-875bff390fe68884baf037b513d266be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f1 2023-02-16 17:01:22,619 DEBUG [StoreOpener-875bff390fe68884baf037b513d266be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f1 2023-02-16 17:01:22,619 INFO [StoreOpener-875bff390fe68884baf037b513d266be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 875bff390fe68884baf037b513d266be columnFamilyName f1 2023-02-16 17:01:22,620 DEBUG [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f1 2023-02-16 17:01:22,620 DEBUG [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f1 2023-02-16 17:01:22,620 INFO [StoreOpener-875bff390fe68884baf037b513d266be-1] regionserver.HStore(310): Store=875bff390fe68884baf037b513d266be/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,620 INFO [StoreOpener-875bff390fe68884baf037b513d266be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 875bff390fe68884baf037b513d266be 2023-02-16 17:01:22,620 INFO [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e95d77046c122a566664ad82ef7297cb columnFamilyName f1 2023-02-16 17:01:22,621 INFO [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] regionserver.HStore(310): Store=e95d77046c122a566664ad82ef7297cb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,621 INFO [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:22,622 DEBUG [StoreOpener-875bff390fe68884baf037b513d266be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f2 2023-02-16 17:01:22,622 DEBUG [StoreOpener-875bff390fe68884baf037b513d266be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f2 2023-02-16 17:01:22,622 INFO [StoreOpener-875bff390fe68884baf037b513d266be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 875bff390fe68884baf037b513d266be columnFamilyName f2 2023-02-16 17:01:22,622 DEBUG [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f2 2023-02-16 17:01:22,622 DEBUG [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f2 2023-02-16 17:01:22,623 INFO [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e95d77046c122a566664ad82ef7297cb columnFamilyName f2 2023-02-16 17:01:22,623 INFO [StoreOpener-875bff390fe68884baf037b513d266be-1] regionserver.HStore(310): Store=875bff390fe68884baf037b513d266be/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,623 INFO [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] regionserver.HStore(310): Store=e95d77046c122a566664ad82ef7297cb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be 2023-02-16 17:01:22,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be 2023-02-16 17:01:22,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:22,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:22,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:22,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:22,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:22,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 875bff390fe68884baf037b513d266be 2023-02-16 17:01:22,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:22,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e95d77046c122a566664ad82ef7297cb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69501948, jitterRate=0.035659730434417725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:22,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e95d77046c122a566664ad82ef7297cb: 2023-02-16 17:01:22,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb., pid=24, masterSystemTime=1676566882579 2023-02-16 17:01:22,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:22,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:22,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:22,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 58e5e6c9f4fc62b6d822876844eb0bb8, NAME => 'testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 17:01:22,637 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e95d77046c122a566664ad82ef7297cb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:22,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:22,637 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882637"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566882637"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566882637"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566882637"}]},"ts":"1676566882637"} 2023-02-16 17:01:22,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:22,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:22,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:22,639 INFO [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:22,641 DEBUG [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f1 2023-02-16 17:01:22,641 DEBUG [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f1 2023-02-16 17:01:22,641 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=14 2023-02-16 17:01:22,641 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=14, state=SUCCESS; OpenRegionProcedure e95d77046c122a566664ad82ef7297cb, server=jenkins-hbase4.apache.org,46395,1676566880323 in 209 msec 2023-02-16 17:01:22,641 INFO [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58e5e6c9f4fc62b6d822876844eb0bb8 columnFamilyName f1 2023-02-16 17:01:22,642 INFO [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] regionserver.HStore(310): Store=58e5e6c9f4fc62b6d822876844eb0bb8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,642 INFO [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:22,643 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e95d77046c122a566664ad82ef7297cb, ASSIGN in 376 msec 2023-02-16 17:01:22,644 DEBUG [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f2 2023-02-16 17:01:22,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:22,644 DEBUG [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f2 2023-02-16 17:01:22,644 INFO [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58e5e6c9f4fc62b6d822876844eb0bb8 columnFamilyName f2 2023-02-16 17:01:22,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 875bff390fe68884baf037b513d266be; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64526341, jitterRate=-0.03848259150981903}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:22,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 875bff390fe68884baf037b513d266be: 2023-02-16 17:01:22,645 INFO [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] regionserver.HStore(310): Store=58e5e6c9f4fc62b6d822876844eb0bb8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:22,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:22,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be., pid=30, masterSystemTime=1676566882599 2023-02-16 17:01:22,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:22,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:22,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:22,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:22,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 188a18d4a83aa31efed57f073fc3c3ca, NAME => 'testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 17:01:22,650 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=875bff390fe68884baf037b513d266be, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:22,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:22,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:22,651 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676566881676.875bff390fe68884baf037b513d266be.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882650"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566882650"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566882650"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566882650"}]},"ts":"1676566882650"} 2023-02-16 17:01:22,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:22,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:22,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:22,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-16 17:01:22,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure 875bff390fe68884baf037b513d266be, server=jenkins-hbase4.apache.org,37759,1676566880278 in 205 msec 2023-02-16 17:01:22,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=875bff390fe68884baf037b513d266be, ASSIGN in 390 msec 2023-02-16 17:01:22,660 INFO [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:22,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:22,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 58e5e6c9f4fc62b6d822876844eb0bb8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73108718, jitterRate=0.08940479159355164}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:22,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 58e5e6c9f4fc62b6d822876844eb0bb8: 2023-02-16 17:01:22,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8., pid=22, masterSystemTime=1676566882579 2023-02-16 17:01:22,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:22,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:22,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:22,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aca79748b01eee0631c3c829c9d22222, NAME => 'testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 17:01:22,664 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=58e5e6c9f4fc62b6d822876844eb0bb8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:22,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:22,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:22,665 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882664"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566882664"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566882664"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566882664"}]},"ts":"1676566882664"} 2023-02-16 17:01:22,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:22,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:22,667 INFO [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:22,668 DEBUG [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca/f1 2023-02-16 17:01:22,668 DEBUG [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca/f1 2023-02-16 17:01:22,669 DEBUG [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222/f1 2023-02-16 17:01:22,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-16 17:01:22,669 DEBUG [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222/f1 2023-02-16 17:01:22,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 58e5e6c9f4fc62b6d822876844eb0bb8, server=jenkins-hbase4.apache.org,46395,1676566880323 in 240 msec 2023-02-16 17:01:22,669 INFO [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 188a18d4a83aa31efed57f073fc3c3ca columnFamilyName f1 2023-02-16 17:01:22,669 INFO [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aca79748b01eee0631c3c829c9d22222 columnFamilyName f1 2023-02-16 17:01:22,670 INFO [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] regionserver.HStore(310): Store=188a18d4a83aa31efed57f073fc3c3ca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,670 INFO [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] regionserver.HStore(310): Store=aca79748b01eee0631c3c829c9d22222/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,670 INFO [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:22,670 INFO [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:22,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=58e5e6c9f4fc62b6d822876844eb0bb8, ASSIGN in 404 msec 2023-02-16 17:01:22,671 DEBUG [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca/f2 2023-02-16 17:01:22,672 DEBUG [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca/f2 2023-02-16 17:01:22,672 DEBUG [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222/f2 2023-02-16 17:01:22,672 DEBUG [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222/f2 2023-02-16 17:01:22,672 INFO [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 188a18d4a83aa31efed57f073fc3c3ca columnFamilyName f2 2023-02-16 17:01:22,672 INFO [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aca79748b01eee0631c3c829c9d22222 columnFamilyName f2 2023-02-16 17:01:22,674 INFO [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] regionserver.HStore(310): Store=aca79748b01eee0631c3c829c9d22222/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,674 INFO [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] regionserver.HStore(310): Store=188a18d4a83aa31efed57f073fc3c3ca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:22,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:22,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:22,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:22,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:22,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:22,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:22,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:22,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:22,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:22,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened aca79748b01eee0631c3c829c9d22222; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59661218, jitterRate=-0.11097857356071472}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:22,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 188a18d4a83aa31efed57f073fc3c3ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70955703, jitterRate=0.057322368025779724}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:22,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for aca79748b01eee0631c3c829c9d22222: 2023-02-16 17:01:22,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 188a18d4a83aa31efed57f073fc3c3ca: 2023-02-16 17:01:22,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca., pid=27, masterSystemTime=1676566882599 2023-02-16 17:01:22,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222., pid=23, masterSystemTime=1676566882579 2023-02-16 17:01:22,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:22,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:22,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:22,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ad1324f80ea4b890ddd8023ad0f192ee, NAME => 'testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 17:01:22,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:22,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:22,689 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=188a18d4a83aa31efed57f073fc3c3ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:22,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:22,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:22,689 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566882689"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566882689"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566882689"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566882689"}]},"ts":"1676566882689"} 2023-02-16 17:01:22,690 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aca79748b01eee0631c3c829c9d22222, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:22,690 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676566882690"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566882690"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566882690"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566882690"}]},"ts":"1676566882690"} 2023-02-16 17:01:22,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:22,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:22,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:22,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 58032a9cabb92e3926c24738e77cb25e, NAME => 'testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 17:01:22,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:22,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:22,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:22,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:22,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-16 17:01:22,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure 188a18d4a83aa31efed57f073fc3c3ca, server=jenkins-hbase4.apache.org,37759,1676566880278 in 255 msec 2023-02-16 17:01:22,696 INFO [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:22,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-16 17:01:22,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure aca79748b01eee0631c3c829c9d22222, server=jenkins-hbase4.apache.org,46395,1676566880323 in 266 msec 2023-02-16 17:01:22,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=188a18d4a83aa31efed57f073fc3c3ca, ASSIGN in 431 msec 2023-02-16 17:01:22,698 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=aca79748b01eee0631c3c829c9d22222, ASSIGN in 431 msec 2023-02-16 17:01:22,698 DEBUG [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f1 2023-02-16 17:01:22,699 DEBUG [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f1 2023-02-16 17:01:22,699 INFO [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad1324f80ea4b890ddd8023ad0f192ee columnFamilyName f1 2023-02-16 17:01:22,702 INFO [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] regionserver.HStore(310): Store=ad1324f80ea4b890ddd8023ad0f192ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,703 INFO [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:22,704 INFO [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:22,710 DEBUG [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f1 2023-02-16 17:01:22,710 DEBUG [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f1 2023-02-16 17:01:22,711 INFO [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58032a9cabb92e3926c24738e77cb25e columnFamilyName f1 2023-02-16 17:01:22,711 DEBUG [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f2 2023-02-16 17:01:22,711 DEBUG [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f2 2023-02-16 17:01:22,711 INFO [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] regionserver.HStore(310): Store=58032a9cabb92e3926c24738e77cb25e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,711 INFO [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:22,712 INFO [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad1324f80ea4b890ddd8023ad0f192ee columnFamilyName f2 2023-02-16 17:01:22,713 INFO [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] regionserver.HStore(310): Store=ad1324f80ea4b890ddd8023ad0f192ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,714 DEBUG [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f2 2023-02-16 17:01:22,714 DEBUG [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f2 2023-02-16 17:01:22,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:22,714 INFO [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58032a9cabb92e3926c24738e77cb25e columnFamilyName f2 2023-02-16 17:01:22,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:22,715 INFO [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] regionserver.HStore(310): Store=58032a9cabb92e3926c24738e77cb25e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:22,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:22,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:22,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:22,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:22,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:22,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ad1324f80ea4b890ddd8023ad0f192ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68040128, jitterRate=0.013876914978027344}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:22,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ad1324f80ea4b890ddd8023ad0f192ee: 2023-02-16 17:01:22,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:22,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee., pid=26, masterSystemTime=1676566882599 2023-02-16 17:01:22,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:22,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:22,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:22,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:22,724 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ad1324f80ea4b890ddd8023ad0f192ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:22,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4023075ec5bc920cad48017303aae017, NAME => 'testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 17:01:22,725 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882724"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566882724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566882724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566882724"}]},"ts":"1676566882724"} 2023-02-16 17:01:22,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4023075ec5bc920cad48017303aae017 2023-02-16 17:01:22,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:22,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4023075ec5bc920cad48017303aae017 2023-02-16 17:01:22,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4023075ec5bc920cad48017303aae017 2023-02-16 17:01:22,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 58032a9cabb92e3926c24738e77cb25e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74172018, jitterRate=0.10524919629096985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:22,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 58032a9cabb92e3926c24738e77cb25e: 2023-02-16 17:01:22,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e., pid=25, masterSystemTime=1676566882579 2023-02-16 17:01:22,727 INFO [StoreOpener-4023075ec5bc920cad48017303aae017-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4023075ec5bc920cad48017303aae017 2023-02-16 17:01:22,729 DEBUG [StoreOpener-4023075ec5bc920cad48017303aae017-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f1 2023-02-16 17:01:22,729 DEBUG [StoreOpener-4023075ec5bc920cad48017303aae017-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f1 2023-02-16 17:01:22,729 INFO [StoreOpener-4023075ec5bc920cad48017303aae017-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4023075ec5bc920cad48017303aae017 columnFamilyName f1 2023-02-16 17:01:22,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:22,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:22,730 INFO [StoreOpener-4023075ec5bc920cad48017303aae017-1] regionserver.HStore(310): Store=4023075ec5bc920cad48017303aae017/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-16 17:01:22,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure ad1324f80ea4b890ddd8023ad0f192ee, server=jenkins-hbase4.apache.org,37759,1676566880278 in 293 msec 2023-02-16 17:01:22,730 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=58032a9cabb92e3926c24738e77cb25e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:22,730 INFO [StoreOpener-4023075ec5bc920cad48017303aae017-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4023075ec5bc920cad48017303aae017 2023-02-16 17:01:22,730 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882730"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566882730"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566882730"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566882730"}]},"ts":"1676566882730"} 2023-02-16 17:01:22,732 DEBUG [StoreOpener-4023075ec5bc920cad48017303aae017-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f2 2023-02-16 17:01:22,732 DEBUG [StoreOpener-4023075ec5bc920cad48017303aae017-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f2 2023-02-16 17:01:22,733 INFO [StoreOpener-4023075ec5bc920cad48017303aae017-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4023075ec5bc920cad48017303aae017 columnFamilyName f2 2023-02-16 17:01:22,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ad1324f80ea4b890ddd8023ad0f192ee, ASSIGN in 465 msec 2023-02-16 17:01:22,733 INFO [StoreOpener-4023075ec5bc920cad48017303aae017-1] regionserver.HStore(310): Store=4023075ec5bc920cad48017303aae017/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017 2023-02-16 17:01:22,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-16 17:01:22,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017 2023-02-16 17:01:22,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure 58032a9cabb92e3926c24738e77cb25e, server=jenkins-hbase4.apache.org,46395,1676566880323 in 302 msec 2023-02-16 17:01:22,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=58032a9cabb92e3926c24738e77cb25e, ASSIGN in 470 msec 2023-02-16 17:01:22,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:22,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4023075ec5bc920cad48017303aae017 2023-02-16 17:01:22,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:22,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4023075ec5bc920cad48017303aae017; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74913547, jitterRate=0.11629883944988251}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:22,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4023075ec5bc920cad48017303aae017: 2023-02-16 17:01:22,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017., pid=29, masterSystemTime=1676566882599 2023-02-16 17:01:22,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:22,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:22,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:22,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3e2d3fd9abcc8caa75c6e93ce27d935e, NAME => 'testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 17:01:22,744 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=4023075ec5bc920cad48017303aae017, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:22,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:22,744 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882744"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566882744"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566882744"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566882744"}]},"ts":"1676566882744"} 2023-02-16 17:01:22,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:22,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:22,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:22,746 INFO [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:22,748 DEBUG [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f1 2023-02-16 17:01:22,748 DEBUG [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f1 2023-02-16 17:01:22,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=12 2023-02-16 17:01:22,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=12, state=SUCCESS; OpenRegionProcedure 4023075ec5bc920cad48017303aae017, server=jenkins-hbase4.apache.org,37759,1676566880278 in 307 msec 2023-02-16 17:01:22,748 INFO [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e2d3fd9abcc8caa75c6e93ce27d935e columnFamilyName f1 2023-02-16 17:01:22,749 INFO [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] regionserver.HStore(310): Store=3e2d3fd9abcc8caa75c6e93ce27d935e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,749 INFO [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:22,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4023075ec5bc920cad48017303aae017, ASSIGN in 483 msec 2023-02-16 17:01:22,750 DEBUG [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f2 2023-02-16 17:01:22,751 DEBUG [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f2 2023-02-16 17:01:22,751 INFO [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e2d3fd9abcc8caa75c6e93ce27d935e columnFamilyName f2 2023-02-16 17:01:22,751 INFO [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] regionserver.HStore(310): Store=3e2d3fd9abcc8caa75c6e93ce27d935e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:22,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:22,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:22,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:22,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:22,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:22,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3e2d3fd9abcc8caa75c6e93ce27d935e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67030539, jitterRate=-0.0011671334505081177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:22,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3e2d3fd9abcc8caa75c6e93ce27d935e: 2023-02-16 17:01:22,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e., pid=28, masterSystemTime=1676566882599 2023-02-16 17:01:22,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:22,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:22,764 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3e2d3fd9abcc8caa75c6e93ce27d935e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:22,764 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676566882764"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566882764"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566882764"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566882764"}]},"ts":"1676566882764"} 2023-02-16 17:01:22,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-16 17:01:22,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 3e2d3fd9abcc8caa75c6e93ce27d935e, server=jenkins-hbase4.apache.org,37759,1676566880278 in 328 msec 2023-02-16 17:01:22,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=10 2023-02-16 17:01:22,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3e2d3fd9abcc8caa75c6e93ce27d935e, ASSIGN in 503 msec 2023-02-16 17:01:22,770 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:22,771 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566882770"}]},"ts":"1676566882770"} 2023-02-16 17:01:22,772 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 17:01:22,775 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:22,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.0990 sec 2023-02-16 17:01:22,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:22,817 INFO [Listener at localhost/41389] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 17:01:22,817 DEBUG [Listener at localhost/41389] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 17:01:22,818 INFO [Listener at localhost/41389] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:22,822 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 17:01:22,822 INFO [Listener at localhost/41389] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:22,822 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 17:01:22,822 INFO [Listener at localhost/41389] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 17:01:22,885 DEBUG [hconnection-0x67678bc4-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:22,906 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52034, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:22,917 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46395] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:22,927 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37759] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:23,027 INFO [Listener at localhost/41389] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 17:01:23,027 INFO [Listener at localhost/41389] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 17:01:23,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 17:01:23,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676566883029 (current time:1676566883029). 2023-02-16 17:01:23,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 17:01:23,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] zookeeper.ReadOnlyZKClient(139): Connect 0x14588651 to 127.0.0.1:54475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:23,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ea162ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:23,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:23,038 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40770, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:23,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14588651 to 127.0.0.1:54475 2023-02-16 17:01:23,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:23,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 17:01:23,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 17:01:23,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 17:01:23,043 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 17:01:23,044 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676567483044 2023-02-16 17:01:23,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 17:01:23,044 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 17:01:23,045 DEBUG [Listener at localhost/41389] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:23,045 DEBUG [Listener at localhost/41389] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 17:01:23,046 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 17:01:23,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 17:01:23,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-16 17:01:23,048 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 17:01:23,048 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676567483048 2023-02-16 17:01:23,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,060 INFO [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-16 17:01:23,060 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:23,061 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-16 17:01:23,061 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-16 17:01:23,062 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,062 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,064 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:23,064 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:23,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:23,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:23,064 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:23,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:23,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:23,064 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:23,064 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:23,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,065 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:23,065 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:23,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-16 17:01:23,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 17:01:23,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-16 17:01:23,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-16 17:01:23,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,068 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-16 17:01:23,068 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:23,068 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-16 17:01:23,069 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:23,068 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-16 17:01:23,069 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-16 17:01:23,069 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-16 17:01:23,069 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-16 17:01:23,069 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46395,1676566880323' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-16 17:01:23,069 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37759,1676566880278' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-16 17:01:23,072 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:23,072 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:23,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:23,072 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:23,072 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,073 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,073 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:23,073 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,073 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:23,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:23,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:23,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:23,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:23,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:23,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37759,1676566880278' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-16 17:01:23,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60b78608[Count = 1] remaining members to acquire global barrier 2023-02-16 17:01:23,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:23,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:23,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:23,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:23,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:23,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:23,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:23,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:23,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46395,1676566880323' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-16 17:01:23,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60b78608[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:23,080 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-16 17:01:23,080 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,081 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,081 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,081 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-16 17:01:23,081 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:23,081 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-16 17:01:23,082 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:23,082 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:23,085 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:23,085 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. started... 2023-02-16 17:01:23,085 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:23,085 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:23,086 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. started... 2023-02-16 17:01:23,088 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:23,086 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. started... 2023-02-16 17:01:23,088 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. started... 2023-02-16 17:01:23,090 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:23,091 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7276e6cb858090b97da96b3cd2751ce7 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 17:01:23,088 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 17:01:23,088 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:23,088 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 17:01:23,092 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 17:01:23,086 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 188a18d4a83aa31efed57f073fc3c3ca: 2023-02-16 17:01:23,092 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. started... 2023-02-16 17:01:23,092 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 17:01:23,091 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. started... 2023-02-16 17:01:23,093 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,091 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 58e5e6c9f4fc62b6d822876844eb0bb8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:23,090 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3e2d3fd9abcc8caa75c6e93ce27d935e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:23,093 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:23,093 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 17:01:23,093 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 17:01:23,093 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] regionserver.HRegion(2744): Flushing ad1324f80ea4b890ddd8023ad0f192ee 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:23,100 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for aca79748b01eee0631c3c829c9d22222: 2023-02-16 17:01:23,100 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,100 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:23,100 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 17:01:23,100 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 17:01:23,133 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. completed. 2023-02-16 17:01:23,133 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:23,133 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:23,133 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 17:01:23,133 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. started... 2023-02-16 17:01:23,141 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/.tmp/f1/7f1a4e3fa61347faa9b1ae5b62530d2a 2023-02-16 17:01:23,149 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4023075ec5bc920cad48017303aae017 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 17:01:23,152 DEBUG [Listener at localhost/41389] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:23,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 17:01:23,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:23,154 DEBUG [Listener at localhost/41389] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 17:01:23,158 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/.tmp/f1/eb6d19e1edea4ce8a1390bbb9ac8bfc2 2023-02-16 17:01:23,173 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. completed. 2023-02-16 17:01:23,173 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:23,173 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:23,173 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 17:01:23,173 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. started... 2023-02-16 17:01:23,173 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/.tmp/f1/f517a85d0b364d52801fd5b8a79020df 2023-02-16 17:01:23,173 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e95d77046c122a566664ad82ef7297cb 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:23,211 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 17:01:23,264 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/.tmp/f1/66c628ba24014eaeb043dddf4c35ab03 2023-02-16 17:01:23,269 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/.tmp/f1/a19fce3a80d84040b1c6e7e26767595f 2023-02-16 17:01:23,275 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/.tmp/f2/c92109a89441461092566570e5b1407e 2023-02-16 17:01:23,282 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/.tmp/f1/6628b7489594445495cf49d7250f7b5b 2023-02-16 17:01:23,289 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/.tmp/f1/7f1a4e3fa61347faa9b1ae5b62530d2a as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f1/7f1a4e3fa61347faa9b1ae5b62530d2a 2023-02-16 17:01:23,295 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f1/7f1a4e3fa61347faa9b1ae5b62530d2a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 17:01:23,296 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/.tmp/f2/c92109a89441461092566570e5b1407e as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f2/c92109a89441461092566570e5b1407e 2023-02-16 17:01:23,311 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f2/c92109a89441461092566570e5b1407e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 17:01:23,312 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 7276e6cb858090b97da96b3cd2751ce7 in 221ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:23,312 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-16 17:01:23,313 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7276e6cb858090b97da96b3cd2751ce7: 2023-02-16 17:01:23,313 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,313 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:23,313 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f1/7f1a4e3fa61347faa9b1ae5b62530d2a] hfiles 2023-02-16 17:01:23,313 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f1/7f1a4e3fa61347faa9b1ae5b62530d2a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,313 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f2/c92109a89441461092566570e5b1407e] hfiles 2023-02-16 17:01:23,313 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f2/c92109a89441461092566570e5b1407e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,334 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/.tmp/f2/f0137a60f9df4ed4a871cb2b2b0c8ee7 2023-02-16 17:01:23,339 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/.tmp/f2/41b54a26582d4103a240f4dc7c381cee 2023-02-16 17:01:23,346 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/.tmp/f1/f517a85d0b364d52801fd5b8a79020df as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f1/f517a85d0b364d52801fd5b8a79020df 2023-02-16 17:01:23,348 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/.tmp/f1/66c628ba24014eaeb043dddf4c35ab03 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f1/66c628ba24014eaeb043dddf4c35ab03 2023-02-16 17:01:23,353 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f1/f517a85d0b364d52801fd5b8a79020df, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:23,354 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/.tmp/f2/41b54a26582d4103a240f4dc7c381cee as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f2/41b54a26582d4103a240f4dc7c381cee 2023-02-16 17:01:23,354 DEBUG [Listener at localhost/41389] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:23,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 17:01:23,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:23,357 DEBUG [Listener at localhost/41389] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 17:01:23,362 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f1/66c628ba24014eaeb043dddf4c35ab03, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 17:01:23,366 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/.tmp/f2/f0137a60f9df4ed4a871cb2b2b0c8ee7 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f2/f0137a60f9df4ed4a871cb2b2b0c8ee7 2023-02-16 17:01:23,379 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f2/41b54a26582d4103a240f4dc7c381cee, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:23,385 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3e2d3fd9abcc8caa75c6e93ce27d935e in 295ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:23,386 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. completed. 2023-02-16 17:01:23,386 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:23,386 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:23,386 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 17:01:23,386 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. started... 2023-02-16 17:01:23,387 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 58032a9cabb92e3926c24738e77cb25e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:23,391 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3e2d3fd9abcc8caa75c6e93ce27d935e: 2023-02-16 17:01:23,392 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,392 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:23,392 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f1/f517a85d0b364d52801fd5b8a79020df] hfiles 2023-02-16 17:01:23,392 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f1/f517a85d0b364d52801fd5b8a79020df for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,392 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f2/41b54a26582d4103a240f4dc7c381cee] hfiles 2023-02-16 17:01:23,392 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f2/41b54a26582d4103a240f4dc7c381cee for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,392 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/.tmp/f2/b5b9d5099b084a5c89d1520245e69f06 2023-02-16 17:01:23,392 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/.tmp/f2/e5b04887724848f5ab1b40f46f7490a5 2023-02-16 17:01:23,407 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f2/f0137a60f9df4ed4a871cb2b2b0c8ee7, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 17:01:23,408 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 4023075ec5bc920cad48017303aae017 in 259ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:23,408 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4023075ec5bc920cad48017303aae017: 2023-02-16 17:01:23,408 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,408 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:23,408 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f1/66c628ba24014eaeb043dddf4c35ab03] hfiles 2023-02-16 17:01:23,409 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f1/66c628ba24014eaeb043dddf4c35ab03 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,409 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f2/f0137a60f9df4ed4a871cb2b2b0c8ee7] hfiles 2023-02-16 17:01:23,409 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f2/f0137a60f9df4ed4a871cb2b2b0c8ee7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,414 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/.tmp/f1/6628b7489594445495cf49d7250f7b5b as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f1/6628b7489594445495cf49d7250f7b5b 2023-02-16 17:01:23,424 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f1/6628b7489594445495cf49d7250f7b5b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:23,425 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/.tmp/f2/b5b9d5099b084a5c89d1520245e69f06 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f2/b5b9d5099b084a5c89d1520245e69f06 2023-02-16 17:01:23,428 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/.tmp/f1/a19fce3a80d84040b1c6e7e26767595f as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f1/a19fce3a80d84040b1c6e7e26767595f 2023-02-16 17:01:23,436 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f2/b5b9d5099b084a5c89d1520245e69f06, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:23,437 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e95d77046c122a566664ad82ef7297cb in 264ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:23,437 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e95d77046c122a566664ad82ef7297cb: 2023-02-16 17:01:23,438 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,438 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:23,438 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f1/6628b7489594445495cf49d7250f7b5b] hfiles 2023-02-16 17:01:23,438 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f1/6628b7489594445495cf49d7250f7b5b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,438 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f2/b5b9d5099b084a5c89d1520245e69f06] hfiles 2023-02-16 17:01:23,438 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f2/b5b9d5099b084a5c89d1520245e69f06 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,457 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f1/a19fce3a80d84040b1c6e7e26767595f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:23,459 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/.tmp/f2/e5b04887724848f5ab1b40f46f7490a5 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f2/e5b04887724848f5ab1b40f46f7490a5 2023-02-16 17:01:23,472 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. completed. 2023-02-16 17:01:23,473 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:23,473 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:23,473 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 17:01:23,473 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. started... 2023-02-16 17:01:23,473 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 875bff390fe68884baf037b513d266be 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:23,509 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f2/e5b04887724848f5ab1b40f46f7490a5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:23,511 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ad1324f80ea4b890ddd8023ad0f192ee in 419ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:23,511 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ad1324f80ea4b890ddd8023ad0f192ee: 2023-02-16 17:01:23,511 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,511 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:23,511 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f1/a19fce3a80d84040b1c6e7e26767595f] hfiles 2023-02-16 17:01:23,511 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f1/a19fce3a80d84040b1c6e7e26767595f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,511 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f2/e5b04887724848f5ab1b40f46f7490a5] hfiles 2023-02-16 17:01:23,511 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f2/e5b04887724848f5ab1b40f46f7490a5 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,516 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/.tmp/f1/55040689030b4aa297506189da8c7ccd 2023-02-16 17:01:23,542 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. completed. 2023-02-16 17:01:23,542 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:23,542 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 17:01:23,543 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. completed. 2023-02-16 17:01:23,543 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:23,543 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 17:01:23,559 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/.tmp/f1/afacd72debd749d9900ed8f2648aa0e8 2023-02-16 17:01:23,560 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. completed. 2023-02-16 17:01:23,560 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:23,561 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 17:01:23,570 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/.tmp/f2/209e316f0c0948c0862bb5c9746fb453 2023-02-16 17:01:23,577 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/.tmp/f1/55040689030b4aa297506189da8c7ccd as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f1/55040689030b4aa297506189da8c7ccd 2023-02-16 17:01:23,582 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f1/55040689030b4aa297506189da8c7ccd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:23,582 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/.tmp/f2/d13402fc0dba4afea67a554f9e94f423 2023-02-16 17:01:23,583 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/.tmp/f2/209e316f0c0948c0862bb5c9746fb453 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f2/209e316f0c0948c0862bb5c9746fb453 2023-02-16 17:01:23,588 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/.tmp/f1/afacd72debd749d9900ed8f2648aa0e8 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f1/afacd72debd749d9900ed8f2648aa0e8 2023-02-16 17:01:23,590 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f2/209e316f0c0948c0862bb5c9746fb453, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:23,592 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 58032a9cabb92e3926c24738e77cb25e in 205ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:23,592 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 58032a9cabb92e3926c24738e77cb25e: 2023-02-16 17:01:23,593 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,593 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:23,593 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f1/55040689030b4aa297506189da8c7ccd] hfiles 2023-02-16 17:01:23,593 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f1/55040689030b4aa297506189da8c7ccd for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,593 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f2/209e316f0c0948c0862bb5c9746fb453] hfiles 2023-02-16 17:01:23,593 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f2/209e316f0c0948c0862bb5c9746fb453 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,598 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f1/afacd72debd749d9900ed8f2648aa0e8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:23,599 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/.tmp/f2/d13402fc0dba4afea67a554f9e94f423 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f2/d13402fc0dba4afea67a554f9e94f423 2023-02-16 17:01:23,604 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f2/d13402fc0dba4afea67a554f9e94f423, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:23,605 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 875bff390fe68884baf037b513d266be in 132ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:23,605 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 875bff390fe68884baf037b513d266be: 2023-02-16 17:01:23,605 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,605 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:23,605 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f1/afacd72debd749d9900ed8f2648aa0e8] hfiles 2023-02-16 17:01:23,605 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f1/afacd72debd749d9900ed8f2648aa0e8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,605 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f2/d13402fc0dba4afea67a554f9e94f423] hfiles 2023-02-16 17:01:23,606 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f2/d13402fc0dba4afea67a554f9e94f423 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,618 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. completed. 2023-02-16 17:01:23,618 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:23,618 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 17:01:23,657 DEBUG [Listener at localhost/41389] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:23,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 17:01:23,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:23,659 DEBUG [Listener at localhost/41389] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 17:01:23,672 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/.tmp/f2/8d3d49ff9fb542178dfc855897685ccf 2023-02-16 17:01:23,678 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/.tmp/f1/eb6d19e1edea4ce8a1390bbb9ac8bfc2 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f1/eb6d19e1edea4ce8a1390bbb9ac8bfc2 2023-02-16 17:01:23,684 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f1/eb6d19e1edea4ce8a1390bbb9ac8bfc2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:23,685 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/.tmp/f2/8d3d49ff9fb542178dfc855897685ccf as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f2/8d3d49ff9fb542178dfc855897685ccf 2023-02-16 17:01:23,690 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f2/8d3d49ff9fb542178dfc855897685ccf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:23,691 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 58e5e6c9f4fc62b6d822876844eb0bb8 in 600ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:23,691 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 58e5e6c9f4fc62b6d822876844eb0bb8: 2023-02-16 17:01:23,692 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,692 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:23,692 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f1/eb6d19e1edea4ce8a1390bbb9ac8bfc2] hfiles 2023-02-16 17:01:23,692 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f1/eb6d19e1edea4ce8a1390bbb9ac8bfc2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,692 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f2/8d3d49ff9fb542178dfc855897685ccf] hfiles 2023-02-16 17:01:23,692 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f2/8d3d49ff9fb542178dfc855897685ccf for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,701 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. completed. 2023-02-16 17:01:23,701 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:23,702 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 17:01:23,702 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 17:01:23,702 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:23,702 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-16 17:01:23,702 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,46395,1676566880323' in zk 2023-02-16 17:01:23,704 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:23,704 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-16 17:01:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:23,704 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:23,704 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-16 17:01:23,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:23,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,46395,1676566880323': 2023-02-16 17:01:23,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46395,1676566880323' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 17:01:24,023 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. completed. 2023-02-16 17:01:24,023 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 17:01:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 17:01:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-16 17:01:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,37759,1676566880278' in zk 2023-02-16 17:01:24,027 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-16 17:01:24,027 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,027 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:24,027 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-16 17:01:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:24,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,37759,1676566880278': 2023-02-16 17:01:24,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37759,1676566880278' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 17:01:24,031 INFO [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-16 17:01:24,032 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:24,032 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:24,032 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,032 INFO [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 17:01:24,033 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,033 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,034 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,033 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:24,034 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:24,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:24,034 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:24,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:24,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,035 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:24,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:24,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,038 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,038 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,044 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:24,044 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:24,044 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:24,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:24,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:24,044 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:24,044 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:24,045 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:24,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,045 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,046 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,046 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,046 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,046 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,046 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,046 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,046 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:24,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:24,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:24,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:24,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:24,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,127 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-16 17:01:24,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,128 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:24,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676566883044Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676566884046 (+1002 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676566884046Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676566884059 (+13 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676566884079 (+20 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676566884127 (+48 ms) 2023-02-16 17:01:24,130 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 17:01:24,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0850 sec 2023-02-16 17:01:24,159 DEBUG [Listener at localhost/41389] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:24,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 17:01:24,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 17:01:24,162 INFO [Listener at localhost/41389] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 17:01:24,167 INFO [Listener at localhost/41389] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 17:01:24,176 INFO [Listener at localhost/41389] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 17:01:24,219 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37759] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:24,219 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46395] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:24,317 INFO [Listener at localhost/41389] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 17:01:24,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 17:01:24,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 17:01:24,328 INFO [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 17:01:24,328 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:24,329 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 17:01:24,329 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 17:01:24,329 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,330 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:24,338 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:24,338 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,338 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:24,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:24,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:24,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:24,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:24,339 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:24,339 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:24,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,340 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,340 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:24,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:24,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:24,340 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 17:01:24,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 17:01:24,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:24,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:24,341 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 17:01:24,344 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 17:01:24,344 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:24,347 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 17:01:24,348 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 17:01:24,348 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 17:01:24,348 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:24,353 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 17:01:24,353 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:24,353 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. started... 2023-02-16 17:01:24,353 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7276e6cb858090b97da96b3cd2751ce7 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 17:01:24,355 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:24,364 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 17:01:24,364 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 17:01:24,360 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:24,364 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. started... 2023-02-16 17:01:24,364 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:24,364 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. started... 2023-02-16 17:01:24,364 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. started... 2023-02-16 17:01:24,364 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for aca79748b01eee0631c3c829c9d22222: 2023-02-16 17:01:24,364 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:24,364 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 188a18d4a83aa31efed57f073fc3c3ca: 2023-02-16 17:01:24,364 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 17:01:24,365 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 17:01:24,365 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:24,364 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. started... 2023-02-16 17:01:24,365 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 17:01:24,364 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:24,365 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ad1324f80ea4b890ddd8023ad0f192ee 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:24,365 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:24,365 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. started... 2023-02-16 17:01:24,365 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3e2d3fd9abcc8caa75c6e93ce27d935e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:24,365 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 17:01:24,365 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:24,365 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. started... 2023-02-16 17:01:24,365 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e95d77046c122a566664ad82ef7297cb 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:24,365 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4023075ec5bc920cad48017303aae017 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 17:01:24,365 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:24,366 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. started... 2023-02-16 17:01:24,366 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 58e5e6c9f4fc62b6d822876844eb0bb8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:24,432 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/.tmp/f1/b5dad905483746f3b7df8bc06ad2a20d 2023-02-16 17:01:24,443 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/.tmp/f1/5d48a70575ab4690842df02f512a62c2 2023-02-16 17:01:24,452 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/.tmp/f1/41fd84f314f54d19a8b86300a452004d 2023-02-16 17:01:24,492 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/.tmp/f1/5d5bfdb4c8bb43e3b3c31e87ce99e454 2023-02-16 17:01:24,493 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/.tmp/f1/f6a20d01dc6f4ed5bdcf36c9d40b9dd7 2023-02-16 17:01:24,505 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/.tmp/f1/8ca049a277574626a31e8dafc85fca5e 2023-02-16 17:01:24,540 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/.tmp/f2/1d792f9b45f5428998adb489f78ede24 2023-02-16 17:01:24,551 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/.tmp/f1/41fd84f314f54d19a8b86300a452004d as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f1/41fd84f314f54d19a8b86300a452004d 2023-02-16 17:01:24,552 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/.tmp/f2/2bf6330aaf904caa86ef9cb099091c08 2023-02-16 17:01:24,557 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/.tmp/f2/8be6c3555d1544be99951a14955a7b29 2023-02-16 17:01:24,558 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f1/41fd84f314f54d19a8b86300a452004d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:24,558 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/.tmp/f1/b5dad905483746f3b7df8bc06ad2a20d as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f1/b5dad905483746f3b7df8bc06ad2a20d 2023-02-16 17:01:24,559 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/.tmp/f2/1d792f9b45f5428998adb489f78ede24 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f2/1d792f9b45f5428998adb489f78ede24 2023-02-16 17:01:24,563 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/.tmp/f1/5d48a70575ab4690842df02f512a62c2 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f1/5d48a70575ab4690842df02f512a62c2 2023-02-16 17:01:24,565 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f2/1d792f9b45f5428998adb489f78ede24, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:24,566 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ad1324f80ea4b890ddd8023ad0f192ee in 200ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:24,566 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ad1324f80ea4b890ddd8023ad0f192ee: 2023-02-16 17:01:24,566 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:24,566 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:24,566 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 17:01:24,566 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. started... 2023-02-16 17:01:24,566 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 875bff390fe68884baf037b513d266be 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:24,584 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f1/b5dad905483746f3b7df8bc06ad2a20d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 17:01:24,585 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/.tmp/f2/1d774c69f9764da3a2121a4d13a6eb07 2023-02-16 17:01:24,586 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/.tmp/f2/2bf6330aaf904caa86ef9cb099091c08 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f2/2bf6330aaf904caa86ef9cb099091c08 2023-02-16 17:01:24,587 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f1/5d48a70575ab4690842df02f512a62c2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:24,588 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/.tmp/f2/465d1c3a121943a697b54e464bc7fd6d 2023-02-16 17:01:24,589 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/.tmp/f2/8be6c3555d1544be99951a14955a7b29 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f2/8be6c3555d1544be99951a14955a7b29 2023-02-16 17:01:24,592 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/.tmp/f2/a6823805b51a47798a7e0064a14f4309 2023-02-16 17:01:24,595 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/.tmp/f1/f6a20d01dc6f4ed5bdcf36c9d40b9dd7 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f1/f6a20d01dc6f4ed5bdcf36c9d40b9dd7 2023-02-16 17:01:24,596 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f2/2bf6330aaf904caa86ef9cb099091c08, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 17:01:24,597 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 7276e6cb858090b97da96b3cd2751ce7 in 244ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:24,597 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7276e6cb858090b97da96b3cd2751ce7: 2023-02-16 17:01:24,598 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:24,598 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:24,598 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 17:01:24,598 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f2/8be6c3555d1544be99951a14955a7b29, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:24,598 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. started... 2023-02-16 17:01:24,599 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 58032a9cabb92e3926c24738e77cb25e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:24,599 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e95d77046c122a566664ad82ef7297cb in 234ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:24,599 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e95d77046c122a566664ad82ef7297cb: 2023-02-16 17:01:24,599 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:24,600 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/.tmp/f1/8ca049a277574626a31e8dafc85fca5e as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f1/8ca049a277574626a31e8dafc85fca5e 2023-02-16 17:01:24,600 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 17:01:24,608 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/.tmp/f1/0e5c128d556c451198bcbe31ccf07b65 2023-02-16 17:01:24,609 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f1/8ca049a277574626a31e8dafc85fca5e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 17:01:24,611 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/.tmp/f2/465d1c3a121943a697b54e464bc7fd6d as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f2/465d1c3a121943a697b54e464bc7fd6d 2023-02-16 17:01:24,612 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/.tmp/f1/5d5bfdb4c8bb43e3b3c31e87ce99e454 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f1/5d5bfdb4c8bb43e3b3c31e87ce99e454 2023-02-16 17:01:24,613 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f1/f6a20d01dc6f4ed5bdcf36c9d40b9dd7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:24,614 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/.tmp/f2/1d774c69f9764da3a2121a4d13a6eb07 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f2/1d774c69f9764da3a2121a4d13a6eb07 2023-02-16 17:01:24,617 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f2/465d1c3a121943a697b54e464bc7fd6d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 17:01:24,621 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 4023075ec5bc920cad48017303aae017 in 256ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:24,621 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4023075ec5bc920cad48017303aae017: 2023-02-16 17:01:24,621 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f1/5d5bfdb4c8bb43e3b3c31e87ce99e454, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:24,621 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:24,621 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 17:01:24,622 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/.tmp/f2/a6823805b51a47798a7e0064a14f4309 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f2/a6823805b51a47798a7e0064a14f4309 2023-02-16 17:01:24,623 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f2/1d774c69f9764da3a2121a4d13a6eb07, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:24,623 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/.tmp/f1/7d2e358186d541ccae053ec7421ae53e 2023-02-16 17:01:24,624 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 58e5e6c9f4fc62b6d822876844eb0bb8 in 258ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:24,624 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 58e5e6c9f4fc62b6d822876844eb0bb8: 2023-02-16 17:01:24,624 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:24,624 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 17:01:24,629 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f2/a6823805b51a47798a7e0064a14f4309, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:24,630 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3e2d3fd9abcc8caa75c6e93ce27d935e in 266ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:24,630 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3e2d3fd9abcc8caa75c6e93ce27d935e: 2023-02-16 17:01:24,630 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:24,630 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 17:01:24,636 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/.tmp/f2/9a08e624d7ef41878b94515047d6c09a 2023-02-16 17:01:24,642 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/.tmp/f1/0e5c128d556c451198bcbe31ccf07b65 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f1/0e5c128d556c451198bcbe31ccf07b65 2023-02-16 17:01:24,644 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/.tmp/f2/97d96fe77a6f402a8e35bf1402548294 2023-02-16 17:01:24,648 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f1/0e5c128d556c451198bcbe31ccf07b65, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:24,648 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/.tmp/f2/9a08e624d7ef41878b94515047d6c09a as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f2/9a08e624d7ef41878b94515047d6c09a 2023-02-16 17:01:24,653 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/.tmp/f1/7d2e358186d541ccae053ec7421ae53e as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f1/7d2e358186d541ccae053ec7421ae53e 2023-02-16 17:01:24,653 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f2/9a08e624d7ef41878b94515047d6c09a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:24,654 INFO [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 875bff390fe68884baf037b513d266be in 88ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:24,654 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 875bff390fe68884baf037b513d266be: 2023-02-16 17:01:24,654 DEBUG [rs(jenkins-hbase4.apache.org,37759,1676566880278)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:24,654 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 17:01:24,654 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 17:01:24,654 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,654 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 17:01:24,654 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37759,1676566880278' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 17:01:24,656 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,656 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:24,657 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,657 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:24,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37759,1676566880278' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 17:01:24,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64880ec6[Count = 1] remaining members to acquire global barrier 2023-02-16 17:01:24,659 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f1/7d2e358186d541ccae053ec7421ae53e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:24,659 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/.tmp/f2/97d96fe77a6f402a8e35bf1402548294 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f2/97d96fe77a6f402a8e35bf1402548294 2023-02-16 17:01:24,664 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f2/97d96fe77a6f402a8e35bf1402548294, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:24,665 INFO [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 58032a9cabb92e3926c24738e77cb25e in 66ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:24,665 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 58032a9cabb92e3926c24738e77cb25e: 2023-02-16 17:01:24,665 DEBUG [rs(jenkins-hbase4.apache.org,46395,1676566880323)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:24,665 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 17:01:24,665 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 17:01:24,665 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,665 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 17:01:24,666 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46395,1676566880323' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 17:01:24,667 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,667 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:24,668 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,668 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:24,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:24,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:24,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:24,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:24,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46395,1676566880323' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 17:01:24,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64880ec6[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:24,669 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 17:01:24,669 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,671 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,671 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,671 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,671 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 17:01:24,671 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 17:01:24,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,671 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46395,1676566880323' in zk 2023-02-16 17:01:24,671 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 17:01:24,671 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 17:01:24,671 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,37759,1676566880278' in zk 2023-02-16 17:01:24,671 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,671 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:24,674 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,674 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 17:01:24,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:24,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:24,674 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:24,674 DEBUG [member: 'jenkins-hbase4.apache.org,37759,1676566880278' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 17:01:24,675 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 17:01:24,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:24,675 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:24,675 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,675 DEBUG [member: 'jenkins-hbase4.apache.org,46395,1676566880323' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 17:01:24,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:24,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:24,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:24,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:24,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,37759,1676566880278': 2023-02-16 17:01:24,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37759,1676566880278' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-16 17:01:24,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:24,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:24,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:24,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:24,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:24,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:24,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:24,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,46395,1676566880323': 2023-02-16 17:01:24,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46395,1676566880323' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 17:01:24,682 INFO [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 17:01:24,682 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:24,682 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:24,682 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 17:01:24,682 INFO [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 17:01:24,684 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,684 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,684 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:24,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:24,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:24,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,684 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,684 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:24,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:24,684 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:24,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,685 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:24,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:24,691 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:24,692 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,697 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:24,697 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:24,697 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,697 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:24,697 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,697 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:24,697 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,697 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,697 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,697 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:24,697 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:24,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:24,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:24,697 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:24,698 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:24,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:24,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:24,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 17:01:24,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:24,697 DEBUG [(jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:24,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:24,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 17:01:24,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:24,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:24,699 DEBUG [Listener at localhost/41389] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:24,700 DEBUG [Listener at localhost/41389] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 17:01:24,800 DEBUG [Listener at localhost/41389] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 17:01:24,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38729] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 17:01:24,801 INFO [Listener at localhost/41389] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 17:01:24,802 DEBUG [Listener at localhost/41389] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a3e6541 to 127.0.0.1:54475 2023-02-16 17:01:24,802 DEBUG [Listener at localhost/41389] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:24,802 DEBUG [Listener at localhost/41389] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 17:01:24,802 DEBUG [Listener at localhost/41389] util.JVMClusterUtil(257): Found active master hash=1946801148, stopped=false 2023-02-16 17:01:24,802 INFO [Listener at localhost/41389] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38729,1676566880205 2023-02-16 17:01:24,805 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:24,805 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:24,805 INFO [Listener at localhost/41389] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 17:01:24,805 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:24,805 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:24,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:24,807 DEBUG [Listener at localhost/41389] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37f0aa88 to 127.0.0.1:54475 2023-02-16 17:01:24,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:24,807 DEBUG [Listener at localhost/41389] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:24,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:24,807 INFO [Listener at localhost/41389] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37759,1676566880278' ***** 2023-02-16 17:01:24,807 INFO [Listener at localhost/41389] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:24,807 INFO [Listener at localhost/41389] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46395,1676566880323' ***** 2023-02-16 17:01:24,807 INFO [Listener at localhost/41389] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:24,807 INFO [RS:0;jenkins-hbase4:37759] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:24,808 INFO [RS:1;jenkins-hbase4:46395] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:24,808 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:24,808 INFO [RS:1;jenkins-hbase4:46395] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:24,808 INFO [RS:0;jenkins-hbase4:37759] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:24,809 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:24,809 INFO [RS:0;jenkins-hbase4:37759] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:24,809 INFO [RS:1;jenkins-hbase4:46395] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:24,810 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(3304): Received CLOSE for 188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:24,810 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(3304): Received CLOSE for 7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:24,810 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(3304): Received CLOSE for 3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:24,810 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(3304): Received CLOSE for 58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:24,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 188a18d4a83aa31efed57f073fc3c3ca, disabling compactions & flushes 2023-02-16 17:01:24,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7276e6cb858090b97da96b3cd2751ce7, disabling compactions & flushes 2023-02-16 17:01:24,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:24,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:24,810 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(3304): Received CLOSE for aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:24,810 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(3304): Received CLOSE for 6567dfb5c531077caa73552d43ebe341 2023-02-16 17:01:24,810 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(3304): Received CLOSE for e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:24,810 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(3304): Received CLOSE for ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:24,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:24,810 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(3304): Received CLOSE for 4023075ec5bc920cad48017303aae017 2023-02-16 17:01:24,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:24,811 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(3304): Received CLOSE for 875bff390fe68884baf037b513d266be 2023-02-16 17:01:24,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. after waiting 0 ms 2023-02-16 17:01:24,811 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:24,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. after waiting 0 ms 2023-02-16 17:01:24,811 DEBUG [RS:0;jenkins-hbase4:37759] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c87b8ab to 127.0.0.1:54475 2023-02-16 17:01:24,810 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(3304): Received CLOSE for 58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:24,811 DEBUG [RS:0;jenkins-hbase4:37759] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:24,811 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:24,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:24,811 DEBUG [RS:1;jenkins-hbase4:46395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33d2fd4e to 127.0.0.1:54475 2023-02-16 17:01:24,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:24,811 DEBUG [RS:1;jenkins-hbase4:46395] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:24,811 INFO [RS:0;jenkins-hbase4:37759] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:24,811 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-16 17:01:24,811 INFO [RS:0;jenkins-hbase4:37759] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:24,811 DEBUG [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(1479): Online Regions={7276e6cb858090b97da96b3cd2751ce7=testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7., 58e5e6c9f4fc62b6d822876844eb0bb8=testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8., aca79748b01eee0631c3c829c9d22222=testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222., e95d77046c122a566664ad82ef7297cb=testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb., 58032a9cabb92e3926c24738e77cb25e=testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e.} 2023-02-16 17:01:24,811 INFO [RS:0;jenkins-hbase4:37759] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:24,812 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 17:01:24,812 DEBUG [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(1505): Waiting on 58032a9cabb92e3926c24738e77cb25e, 58e5e6c9f4fc62b6d822876844eb0bb8, 7276e6cb858090b97da96b3cd2751ce7, aca79748b01eee0631c3c829c9d22222, e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:24,813 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-16 17:01:24,814 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:24,814 DEBUG [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(1479): Online Regions={188a18d4a83aa31efed57f073fc3c3ca=testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca., 3e2d3fd9abcc8caa75c6e93ce27d935e=testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e., 1588230740=hbase:meta,,1.1588230740, 6567dfb5c531077caa73552d43ebe341=hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341., ad1324f80ea4b890ddd8023ad0f192ee=testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee., 4023075ec5bc920cad48017303aae017=testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017., 875bff390fe68884baf037b513d266be=testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be.} 2023-02-16 17:01:24,815 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:24,815 DEBUG [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(1505): Waiting on 1588230740, 188a18d4a83aa31efed57f073fc3c3ca, 3e2d3fd9abcc8caa75c6e93ce27d935e, 4023075ec5bc920cad48017303aae017, 6567dfb5c531077caa73552d43ebe341, 875bff390fe68884baf037b513d266be, ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:24,815 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:24,815 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:24,815 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:24,816 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-16 17:01:24,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 17:01:24,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:24,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:24,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 188a18d4a83aa31efed57f073fc3c3ca: 2023-02-16 17:01:24,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:24,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:24,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7276e6cb858090b97da96b3cd2751ce7: 2023-02-16 17:01:24,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3e2d3fd9abcc8caa75c6e93ce27d935e, disabling compactions & flushes 2023-02-16 17:01:24,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:24,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:24,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:24,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. after waiting 0 ms 2023-02-16 17:01:24,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:24,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 58e5e6c9f4fc62b6d822876844eb0bb8, disabling compactions & flushes 2023-02-16 17:01:24,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:24,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:24,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. after waiting 0 ms 2023-02-16 17:01:24,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:24,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:24,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:24,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:24,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3e2d3fd9abcc8caa75c6e93ce27d935e: 2023-02-16 17:01:24,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:24,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6567dfb5c531077caa73552d43ebe341, disabling compactions & flushes 2023-02-16 17:01:24,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. 2023-02-16 17:01:24,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. 2023-02-16 17:01:24,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. after waiting 0 ms 2023-02-16 17:01:24,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. 2023-02-16 17:01:24,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 6567dfb5c531077caa73552d43ebe341 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 17:01:24,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:24,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 58e5e6c9f4fc62b6d822876844eb0bb8: 2023-02-16 17:01:24,840 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/.tmp/info/f902188443bf4b6487e05a57da7c04bb 2023-02-16 17:01:24,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:24,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing aca79748b01eee0631c3c829c9d22222, disabling compactions & flushes 2023-02-16 17:01:24,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:24,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:24,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. after waiting 0 ms 2023-02-16 17:01:24,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:24,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 17:01:24,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:24,846 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:24,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for aca79748b01eee0631c3c829c9d22222: 2023-02-16 17:01:24,846 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:24,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:24,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e95d77046c122a566664ad82ef7297cb, disabling compactions & flushes 2023-02-16 17:01:24,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:24,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:24,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. after waiting 0 ms 2023-02-16 17:01:24,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:24,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341/.tmp/info/64787f0360324bb282dc60afc54ef024 2023-02-16 17:01:24,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341/.tmp/info/64787f0360324bb282dc60afc54ef024 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341/info/64787f0360324bb282dc60afc54ef024 2023-02-16 17:01:24,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341/info/64787f0360324bb282dc60afc54ef024, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 17:01:24,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:24,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:24,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e95d77046c122a566664ad82ef7297cb: 2023-02-16 17:01:24,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:24,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 58032a9cabb92e3926c24738e77cb25e, disabling compactions & flushes 2023-02-16 17:01:24,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:24,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:24,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. after waiting 0 ms 2023-02-16 17:01:24,878 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:24,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6567dfb5c531077caa73552d43ebe341 in 41ms, sequenceid=6, compaction requested=false 2023-02-16 17:01:24,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-16 17:01:24,884 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/.tmp/table/a900cf1f9df5444cbca6732ad44f90af 2023-02-16 17:01:24,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:24,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/namespace/6567dfb5c531077caa73552d43ebe341/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 17:01:24,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:24,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 58032a9cabb92e3926c24738e77cb25e: 2023-02-16 17:01:24,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:24,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. 2023-02-16 17:01:24,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6567dfb5c531077caa73552d43ebe341: 2023-02-16 17:01:24,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676566881059.6567dfb5c531077caa73552d43ebe341. 2023-02-16 17:01:24,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ad1324f80ea4b890ddd8023ad0f192ee, disabling compactions & flushes 2023-02-16 17:01:24,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:24,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:24,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. after waiting 0 ms 2023-02-16 17:01:24,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:24,894 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/.tmp/info/f902188443bf4b6487e05a57da7c04bb as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/info/f902188443bf4b6487e05a57da7c04bb 2023-02-16 17:01:24,901 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/info/f902188443bf4b6487e05a57da7c04bb, entries=110, sequenceid=32, filesize=18.7 K 2023-02-16 17:01:24,902 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/.tmp/table/a900cf1f9df5444cbca6732ad44f90af as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/table/a900cf1f9df5444cbca6732ad44f90af 2023-02-16 17:01:24,907 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/table/a900cf1f9df5444cbca6732ad44f90af, entries=4, sequenceid=32, filesize=4.8 K 2023-02-16 17:01:24,908 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 92ms, sequenceid=32, compaction requested=false 2023-02-16 17:01:24,908 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-16 17:01:24,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:24,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:24,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ad1324f80ea4b890ddd8023ad0f192ee: 2023-02-16 17:01:24,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:24,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4023075ec5bc920cad48017303aae017, disabling compactions & flushes 2023-02-16 17:01:24,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:24,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:24,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. after waiting 0 ms 2023-02-16 17:01:24,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:24,923 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-16 17:01:24,924 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 17:01:24,924 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:24,924 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:24,924 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:24,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:24,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:24,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4023075ec5bc920cad48017303aae017: 2023-02-16 17:01:24,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:24,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 875bff390fe68884baf037b513d266be, disabling compactions & flushes 2023-02-16 17:01:24,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:24,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:24,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. after waiting 0 ms 2023-02-16 17:01:24,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:24,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:24,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:24,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 875bff390fe68884baf037b513d266be: 2023-02-16 17:01:24,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:25,013 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46395,1676566880323; all regions closed. 2023-02-16 17:01:25,015 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37759,1676566880278; all regions closed. 2023-02-16 17:01:25,020 DEBUG [RS:1;jenkins-hbase4:46395] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/oldWALs 2023-02-16 17:01:25,020 INFO [RS:1;jenkins-hbase4:46395] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46395%2C1676566880323:(num 1676566881683) 2023-02-16 17:01:25,020 DEBUG [RS:1;jenkins-hbase4:46395] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:25,020 INFO [RS:1;jenkins-hbase4:46395] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:25,021 INFO [RS:1;jenkins-hbase4:46395] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:25,021 INFO [RS:1;jenkins-hbase4:46395] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:25,021 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:25,021 INFO [RS:1;jenkins-hbase4:46395] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:25,021 DEBUG [RS:0;jenkins-hbase4:37759] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/oldWALs 2023-02-16 17:01:25,021 INFO [RS:1;jenkins-hbase4:46395] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:25,021 INFO [RS:0;jenkins-hbase4:37759] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37759%2C1676566880278.meta:.meta(num 1676566880968) 2023-02-16 17:01:25,022 INFO [RS:1;jenkins-hbase4:46395] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46395 2023-02-16 17:01:25,025 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:25,025 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:25,025 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:25,025 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46395,1676566880323 2023-02-16 17:01:25,025 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:25,026 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46395,1676566880323] 2023-02-16 17:01:25,026 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46395,1676566880323; numProcessing=1 2023-02-16 17:01:25,027 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46395,1676566880323 already deleted, retry=false 2023-02-16 17:01:25,027 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46395,1676566880323 expired; onlineServers=1 2023-02-16 17:01:25,028 DEBUG [RS:0;jenkins-hbase4:37759] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/oldWALs 2023-02-16 17:01:25,028 INFO [RS:0;jenkins-hbase4:37759] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37759%2C1676566880278:(num 1676566881474) 2023-02-16 17:01:25,028 DEBUG [RS:0;jenkins-hbase4:37759] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:25,028 INFO [RS:0;jenkins-hbase4:37759] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:25,028 INFO [RS:0;jenkins-hbase4:37759] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:25,028 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:25,029 INFO [RS:0;jenkins-hbase4:37759] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37759 2023-02-16 17:01:25,033 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37759,1676566880278 2023-02-16 17:01:25,033 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:25,033 ERROR [Listener at localhost/41389-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e7c7b6 rejected from java.util.concurrent.ThreadPoolExecutor@1d853d2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:25,034 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37759,1676566880278] 2023-02-16 17:01:25,034 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37759,1676566880278; numProcessing=2 2023-02-16 17:01:25,035 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37759,1676566880278 already deleted, retry=false 2023-02-16 17:01:25,035 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37759,1676566880278 expired; onlineServers=0 2023-02-16 17:01:25,035 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38729,1676566880205' ***** 2023-02-16 17:01:25,035 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 17:01:25,036 DEBUG [M:0;jenkins-hbase4:38729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3534d9c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:25,036 INFO [M:0;jenkins-hbase4:38729] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38729,1676566880205 2023-02-16 17:01:25,036 INFO [M:0;jenkins-hbase4:38729] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38729,1676566880205; all regions closed. 2023-02-16 17:01:25,036 DEBUG [M:0;jenkins-hbase4:38729] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:25,036 DEBUG [M:0;jenkins-hbase4:38729] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 17:01:25,036 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 17:01:25,036 DEBUG [M:0;jenkins-hbase4:38729] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 17:01:25,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566880533] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566880533,5,FailOnTimeoutGroup] 2023-02-16 17:01:25,038 INFO [M:0;jenkins-hbase4:38729] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 17:01:25,038 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:25,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566880533] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566880533,5,FailOnTimeoutGroup] 2023-02-16 17:01:25,038 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:25,038 INFO [M:0;jenkins-hbase4:38729] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 17:01:25,039 INFO [M:0;jenkins-hbase4:38729] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 17:01:25,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:25,039 DEBUG [M:0;jenkins-hbase4:38729] master.HMaster(1512): Stopping service threads 2023-02-16 17:01:25,039 INFO [M:0;jenkins-hbase4:38729] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 17:01:25,039 ERROR [M:0;jenkins-hbase4:38729] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 17:01:25,040 INFO [M:0;jenkins-hbase4:38729] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 17:01:25,040 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 17:01:25,040 DEBUG [M:0;jenkins-hbase4:38729] zookeeper.ZKUtil(398): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 17:01:25,040 WARN [M:0;jenkins-hbase4:38729] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 17:01:25,040 INFO [M:0;jenkins-hbase4:38729] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 17:01:25,040 INFO [M:0;jenkins-hbase4:38729] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 17:01:25,041 DEBUG [M:0;jenkins-hbase4:38729] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:25,041 INFO [M:0;jenkins-hbase4:38729] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:25,041 DEBUG [M:0;jenkins-hbase4:38729] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:25,041 DEBUG [M:0;jenkins-hbase4:38729] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:25,041 DEBUG [M:0;jenkins-hbase4:38729] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:25,041 INFO [M:0;jenkins-hbase4:38729] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.95 KB heapSize=120.63 KB 2023-02-16 17:01:25,051 INFO [M:0;jenkins-hbase4:38729] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.95 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/035ce73d28aa4bb2816548f97bca2281 2023-02-16 17:01:25,056 DEBUG [M:0;jenkins-hbase4:38729] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/035ce73d28aa4bb2816548f97bca2281 as hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/035ce73d28aa4bb2816548f97bca2281 2023-02-16 17:01:25,061 INFO [M:0;jenkins-hbase4:38729] regionserver.HStore(1080): Added hdfs://localhost:41429/user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/035ce73d28aa4bb2816548f97bca2281, entries=31, sequenceid=218, filesize=9.0 K 2023-02-16 17:01:25,062 INFO [M:0;jenkins-hbase4:38729] regionserver.HRegion(2947): Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=218, compaction requested=false 2023-02-16 17:01:25,062 INFO [M:0;jenkins-hbase4:38729] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:25,062 DEBUG [M:0;jenkins-hbase4:38729] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:25,066 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/0452744a-6777-adaa-4539-1a88adcd525f/MasterData/WALs/jenkins-hbase4.apache.org,38729,1676566880205/jenkins-hbase4.apache.org%2C38729%2C1676566880205.1676566880423 not finished, retry = 0 2023-02-16 17:01:25,167 INFO [M:0;jenkins-hbase4:38729] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 17:01:25,167 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:25,168 INFO [M:0;jenkins-hbase4:38729] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38729 2023-02-16 17:01:25,176 DEBUG [M:0;jenkins-hbase4:38729] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38729,1676566880205 already deleted, retry=false 2023-02-16 17:01:25,306 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:25,306 INFO [M:0;jenkins-hbase4:38729] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38729,1676566880205; zookeeper connection closed. 2023-02-16 17:01:25,306 ERROR [Listener at localhost/41389-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@17b8901b rejected from java.util.concurrent.ThreadPoolExecutor@13870634[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:25,307 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): master:38729-0x1005e1449710000, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:25,307 ERROR [Listener at localhost/41389-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3472d8f9 rejected from java.util.concurrent.ThreadPoolExecutor@13870634[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:25,406 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:25,406 INFO [RS:0;jenkins-hbase4:37759] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37759,1676566880278; zookeeper connection closed. 2023-02-16 17:01:25,406 ERROR [Listener at localhost/41389-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e35189c rejected from java.util.concurrent.ThreadPoolExecutor@1d853d2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:25,406 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:37759-0x1005e1449710001, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:25,406 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@714a9e20] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@714a9e20 2023-02-16 17:01:25,406 ERROR [Listener at localhost/41389-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@36512720 rejected from java.util.concurrent.ThreadPoolExecutor@1d853d2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:25,506 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:25,506 INFO [RS:1;jenkins-hbase4:46395] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46395,1676566880323; zookeeper connection closed. 2023-02-16 17:01:25,506 ERROR [Listener at localhost/41389-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@57a7a8f7 rejected from java.util.concurrent.ThreadPoolExecutor@539836db[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:25,506 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@43c18941] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@43c18941 2023-02-16 17:01:25,506 DEBUG [Listener at localhost/41389-EventThread] zookeeper.ZKWatcher(600): regionserver:46395-0x1005e1449710002, quorum=127.0.0.1:54475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:25,507 ERROR [Listener at localhost/41389-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4d4c38b1 rejected from java.util.concurrent.ThreadPoolExecutor@539836db[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:25,507 INFO [Listener at localhost/41389] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 17:01:25,605 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/hadoop-1899079931491703435.jar 2023-02-16 17:01:25,610 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676566883029 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:25,611 DEBUG [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce 2023-02-16 17:01:25,611 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(239): region to add: 7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:25,611 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(239): region to add: 3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(239): region to add: 188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(239): region to add: 58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(239): region to add: 4023075ec5bc920cad48017303aae017 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(239): region to add: ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(239): region to add: aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(239): region to add: 875bff390fe68884baf037b513d266be 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(239): region to add: e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(239): region to add: 58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(585): clone region=7276e6cb858090b97da96b3cd2751ce7 as 7276e6cb858090b97da96b3cd2751ce7 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(585): clone region=3e2d3fd9abcc8caa75c6e93ce27d935e as 3e2d3fd9abcc8caa75c6e93ce27d935e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(585): clone region=188a18d4a83aa31efed57f073fc3c3ca as 188a18d4a83aa31efed57f073fc3c3ca in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(585): clone region=58e5e6c9f4fc62b6d822876844eb0bb8 as 58e5e6c9f4fc62b6d822876844eb0bb8 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(585): clone region=4023075ec5bc920cad48017303aae017 as 4023075ec5bc920cad48017303aae017 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(585): clone region=ad1324f80ea4b890ddd8023ad0f192ee as ad1324f80ea4b890ddd8023ad0f192ee in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(585): clone region=aca79748b01eee0631c3c829c9d22222 as aca79748b01eee0631c3c829c9d22222 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(585): clone region=875bff390fe68884baf037b513d266be as 875bff390fe68884baf037b513d266be in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(585): clone region=e95d77046c122a566664ad82ef7297cb as e95d77046c122a566664ad82ef7297cb in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:25,612 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(585): clone region=58032a9cabb92e3926c24738e77cb25e as 58032a9cabb92e3926c24738e77cb25e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-16 17:01:25,613 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7276e6cb858090b97da96b3cd2751ce7, NAME => 'testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e 2023-02-16 17:01:25,616 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3e2d3fd9abcc8caa75c6e93ce27d935e, NAME => 'testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e 2023-02-16 17:01:25,621 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 58e5e6c9f4fc62b6d822876844eb0bb8, NAME => 'testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e 2023-02-16 17:01:25,621 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 4023075ec5bc920cad48017303aae017, NAME => 'testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e 2023-02-16 17:01:25,621 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 188a18d4a83aa31efed57f073fc3c3ca, NAME => 'testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e 2023-02-16 17:01:25,622 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => ad1324f80ea4b890ddd8023ad0f192ee, NAME => 'testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e 2023-02-16 17:01:25,624 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => aca79748b01eee0631c3c829c9d22222, NAME => 'testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e 2023-02-16 17:01:25,627 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 875bff390fe68884baf037b513d266be, NAME => 'testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e 2023-02-16 17:01:25,644 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:25,645 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f517a85d0b364d52801fd5b8a79020df from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,646 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:25,646 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7f1a4e3fa61347faa9b1ae5b62530d2a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,650 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:25,650 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c92109a89441461092566570e5b1407e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,651 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eb6d19e1edea4ce8a1390bbb9ac8bfc2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,651 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:25,651 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:25,651 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a19fce3a80d84040b1c6e7e26767595f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,651 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 66c628ba24014eaeb043dddf4c35ab03 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,652 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 41b54a26582d4103a240f4dc7c381cee from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,653 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:25,653 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing aca79748b01eee0631c3c829c9d22222, disabling compactions & flushes 2023-02-16 17:01:25,653 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:25,653 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:25,653 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. after waiting 0 ms 2023-02-16 17:01:25,653 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:25,653 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:25,653 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for aca79748b01eee0631c3c829c9d22222: 2023-02-16 17:01:25,654 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => e95d77046c122a566664ad82ef7297cb, NAME => 'testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e 2023-02-16 17:01:25,656 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 7276e6cb858090b97da96b3cd2751ce7, disabling compactions & flushes 2023-02-16 17:01:25,656 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 3e2d3fd9abcc8caa75c6e93ce27d935e, disabling compactions & flushes 2023-02-16 17:01:25,656 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:25,656 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:25,656 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:25,657 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:25,657 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. after waiting 0 ms 2023-02-16 17:01:25,657 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:25,657 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:25,657 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 7276e6cb858090b97da96b3cd2751ce7: 2023-02-16 17:01:25,657 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 58032a9cabb92e3926c24738e77cb25e, NAME => 'testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e 2023-02-16 17:01:25,656 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:25,657 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. after waiting 0 ms 2023-02-16 17:01:25,656 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 188a18d4a83aa31efed57f073fc3c3ca, disabling compactions & flushes 2023-02-16 17:01:25,657 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:25,658 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:25,658 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:25,658 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:25,658 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 3e2d3fd9abcc8caa75c6e93ce27d935e: 2023-02-16 17:01:25,658 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. after waiting 0 ms 2023-02-16 17:01:25,658 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:25,658 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:25,658 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 188a18d4a83aa31efed57f073fc3c3ca: 2023-02-16 17:01:25,663 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f0137a60f9df4ed4a871cb2b2b0c8ee7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,663 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8d3d49ff9fb542178dfc855897685ccf from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,663 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e5b04887724848f5ab1b40f46f7490a5 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,669 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing ad1324f80ea4b890ddd8023ad0f192ee, disabling compactions & flushes 2023-02-16 17:01:25,669 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:25,669 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:25,669 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. after waiting 0 ms 2023-02-16 17:01:25,669 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 58e5e6c9f4fc62b6d822876844eb0bb8, disabling compactions & flushes 2023-02-16 17:01:25,669 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:25,669 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 4023075ec5bc920cad48017303aae017, disabling compactions & flushes 2023-02-16 17:01:25,669 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:25,669 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:25,670 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for ad1324f80ea4b890ddd8023ad0f192ee: 2023-02-16 17:01:25,670 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:25,670 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:25,670 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:25,670 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. after waiting 0 ms 2023-02-16 17:01:25,670 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. after waiting 0 ms 2023-02-16 17:01:25,670 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:25,670 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:25,670 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:25,670 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:25,670 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 4023075ec5bc920cad48017303aae017: 2023-02-16 17:01:25,670 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 58e5e6c9f4fc62b6d822876844eb0bb8: 2023-02-16 17:01:25,672 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:25,672 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6628b7489594445495cf49d7250f7b5b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,673 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:25,673 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 55040689030b4aa297506189da8c7ccd from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,676 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b5b9d5099b084a5c89d1520245e69f06 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,676 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 209e316f0c0948c0862bb5c9746fb453 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:25,679 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 58032a9cabb92e3926c24738e77cb25e, disabling compactions & flushes 2023-02-16 17:01:25,679 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:25,679 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing e95d77046c122a566664ad82ef7297cb, disabling compactions & flushes 2023-02-16 17:01:25,679 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:25,679 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:25,679 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. after waiting 0 ms 2023-02-16 17:01:25,679 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:25,679 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:25,679 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. after waiting 0 ms 2023-02-16 17:01:25,679 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:25,679 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:25,679 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 58032a9cabb92e3926c24738e77cb25e: 2023-02-16 17:01:25,679 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:25,679 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for e95d77046c122a566664ad82ef7297cb: 2023-02-16 17:01:26,050 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:26,051 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink afacd72debd749d9900ed8f2648aa0e8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:26,053 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d13402fc0dba4afea67a554f9e94f423 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-16 17:01:26,056 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 875bff390fe68884baf037b513d266be, disabling compactions & flushes 2023-02-16 17:01:26,056 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:26,056 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:26,056 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. after waiting 0 ms 2023-02-16 17:01:26,056 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:26,056 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:26,056 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 875bff390fe68884baf037b513d266be: 2023-02-16 17:01:26,056 INFO [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676566883029 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:26,057 DEBUG [Listener at localhost/41389] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e 2023-02-16 17:01:26,057 DEBUG [Listener at localhost/41389] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e 2023-02-16 17:01:26,057 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-data/ 2023-02-16 17:01:26,058 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |----default/ 2023-02-16 17:01:26,059 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 17:01:26,059 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |----------188a18d4a83aa31efed57f073fc3c3ca/ 2023-02-16 17:01:26,060 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:26,060 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |----------3e2d3fd9abcc8caa75c6e93ce27d935e/ 2023-02-16 17:01:26,060 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:26,060 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:26,061 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=3e2d3fd9abcc8caa75c6e93ce27d935e-f517a85d0b364d52801fd5b8a79020df 2023-02-16 17:01:26,061 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:26,061 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=3e2d3fd9abcc8caa75c6e93ce27d935e-41b54a26582d4103a240f4dc7c381cee 2023-02-16 17:01:26,062 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |----------4023075ec5bc920cad48017303aae017/ 2023-02-16 17:01:26,062 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:26,062 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:26,063 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=4023075ec5bc920cad48017303aae017-66c628ba24014eaeb043dddf4c35ab03 2023-02-16 17:01:26,063 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:26,063 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=4023075ec5bc920cad48017303aae017-f0137a60f9df4ed4a871cb2b2b0c8ee7 2023-02-16 17:01:26,063 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |----------58032a9cabb92e3926c24738e77cb25e/ 2023-02-16 17:01:26,064 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:26,064 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:26,064 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=58032a9cabb92e3926c24738e77cb25e-55040689030b4aa297506189da8c7ccd 2023-02-16 17:01:26,065 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:26,065 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=58032a9cabb92e3926c24738e77cb25e-209e316f0c0948c0862bb5c9746fb453 2023-02-16 17:01:26,065 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |----------58e5e6c9f4fc62b6d822876844eb0bb8/ 2023-02-16 17:01:26,066 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:26,066 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:26,067 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=58e5e6c9f4fc62b6d822876844eb0bb8-eb6d19e1edea4ce8a1390bbb9ac8bfc2 2023-02-16 17:01:26,067 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:26,067 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=58e5e6c9f4fc62b6d822876844eb0bb8-8d3d49ff9fb542178dfc855897685ccf 2023-02-16 17:01:26,067 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |----------7276e6cb858090b97da96b3cd2751ce7/ 2023-02-16 17:01:26,068 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:26,068 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:26,069 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=7276e6cb858090b97da96b3cd2751ce7-7f1a4e3fa61347faa9b1ae5b62530d2a 2023-02-16 17:01:26,069 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:26,069 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=7276e6cb858090b97da96b3cd2751ce7-c92109a89441461092566570e5b1407e 2023-02-16 17:01:26,069 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |----------875bff390fe68884baf037b513d266be/ 2023-02-16 17:01:26,070 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:26,070 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:26,070 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=875bff390fe68884baf037b513d266be-afacd72debd749d9900ed8f2648aa0e8 2023-02-16 17:01:26,070 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:26,071 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=875bff390fe68884baf037b513d266be-d13402fc0dba4afea67a554f9e94f423 2023-02-16 17:01:26,072 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |----------aca79748b01eee0631c3c829c9d22222/ 2023-02-16 17:01:26,072 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:26,072 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |----------ad1324f80ea4b890ddd8023ad0f192ee/ 2023-02-16 17:01:26,073 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:26,073 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:26,073 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=ad1324f80ea4b890ddd8023ad0f192ee-a19fce3a80d84040b1c6e7e26767595f 2023-02-16 17:01:26,073 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:26,074 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=ad1324f80ea4b890ddd8023ad0f192ee-e5b04887724848f5ab1b40f46f7490a5 2023-02-16 17:01:26,074 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |----------e95d77046c122a566664ad82ef7297cb/ 2023-02-16 17:01:26,074 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:26,074 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:26,075 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=e95d77046c122a566664ad82ef7297cb-6628b7489594445495cf49d7250f7b5b 2023-02-16 17:01:26,075 DEBUG [Listener at localhost/41389] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:26,075 DEBUG [Listener at localhost/41389] util.CommonFSUtils(702): |----------------testWithMapReduce=e95d77046c122a566664ad82ef7297cb-b5b9d5099b084a5c89d1520245e69f06 2023-02-16 17:01:26,076 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:26,076 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:26,076 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:26,077 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:27,022 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/hadoop-8884042900554001765.jar 2023-02-16 17:01:27,023 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:27,023 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:27,093 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/hadoop-414268981289647673.jar 2023-02-16 17:01:27,094 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:27,094 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:27,095 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:27,096 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:27,096 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:27,097 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:27,097 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 17:01:27,098 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 17:01:27,098 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 17:01:27,099 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 17:01:27,099 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 17:01:27,100 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 17:01:27,100 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 17:01:27,100 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 17:01:27,101 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 17:01:27,102 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 17:01:27,102 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:27,102 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 17:01:27,103 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 17:01:27,103 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 17:01:27,104 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 17:01:27,179 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/hadoop-4593330934976887925.jar 2023-02-16 17:01:27,179 DEBUG [Listener at localhost/41389] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 17:01:27,193 WARN [Listener at localhost/41389] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 17:01:27,205 WARN [Listener at localhost/41389] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-16 17:01:27,213 INFO [Listener at localhost/41389] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 17:01:27,334 WARN [Listener at localhost/41389] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/mapreduce.cluster.local.dir/1676566887303/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 17:01:27,334 WARN [Listener at localhost/41389] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/mapreduce.cluster.local.dir/1676566887303/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 17:01:27,369 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:27,369 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:27,371 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:27,373 INFO [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:27,374 DEBUG [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f1 2023-02-16 17:01:27,374 INFO [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e2d3fd9abcc8caa75c6e93ce27d935e columnFamilyName f1 2023-02-16 17:01:27,380 DEBUG [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f1/testWithMapReduce=3e2d3fd9abcc8caa75c6e93ce27d935e-f517a85d0b364d52801fd5b8a79020df 2023-02-16 17:01:27,381 INFO [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] regionserver.HStore(310): Store=3e2d3fd9abcc8caa75c6e93ce27d935e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,381 INFO [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3e2d3fd9abcc8caa75c6e93ce27d935e 2023-02-16 17:01:27,382 DEBUG [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f2 2023-02-16 17:01:27,382 INFO [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e2d3fd9abcc8caa75c6e93ce27d935e columnFamilyName f2 2023-02-16 17:01:27,387 DEBUG [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/3e2d3fd9abcc8caa75c6e93ce27d935e/f2/testWithMapReduce=3e2d3fd9abcc8caa75c6e93ce27d935e-41b54a26582d4103a240f4dc7c381cee 2023-02-16 17:01:27,387 INFO [StoreOpener-3e2d3fd9abcc8caa75c6e93ce27d935e-1] regionserver.HStore(310): Store=3e2d3fd9abcc8caa75c6e93ce27d935e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:27,387 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3e2d3fd9abcc8caa75c6e93ce27d935e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72621773, jitterRate=0.08214874565601349}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:27,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3e2d3fd9abcc8caa75c6e93ce27d935e: 2023-02-16 17:01:27,417 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3e2d3fd9abcc8caa75c6e93ce27d935e, disabling compactions & flushes 2023-02-16 17:01:27,418 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:27,418 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:27,418 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. after waiting 0 ms 2023-02-16 17:01:27,418 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:27,419 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676566881676.3e2d3fd9abcc8caa75c6e93ce27d935e. 2023-02-16 17:01:27,419 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3e2d3fd9abcc8caa75c6e93ce27d935e: 2023-02-16 17:01:27,422 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:27,422 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:27,423 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:27,425 INFO [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:27,426 DEBUG [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca/f1 2023-02-16 17:01:27,427 INFO [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 188a18d4a83aa31efed57f073fc3c3ca columnFamilyName f1 2023-02-16 17:01:27,427 INFO [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] regionserver.HStore(310): Store=188a18d4a83aa31efed57f073fc3c3ca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,427 INFO [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 188a18d4a83aa31efed57f073fc3c3ca 2023-02-16 17:01:27,428 DEBUG [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/188a18d4a83aa31efed57f073fc3c3ca/f2 2023-02-16 17:01:27,429 INFO [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 188a18d4a83aa31efed57f073fc3c3ca columnFamilyName f2 2023-02-16 17:01:27,429 INFO [StoreOpener-188a18d4a83aa31efed57f073fc3c3ca-1] regionserver.HStore(310): Store=188a18d4a83aa31efed57f073fc3c3ca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,429 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:27,429 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 188a18d4a83aa31efed57f073fc3c3ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64060465, jitterRate=-0.045424684882164}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:27,429 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 188a18d4a83aa31efed57f073fc3c3ca: 2023-02-16 17:01:27,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 188a18d4a83aa31efed57f073fc3c3ca, disabling compactions & flushes 2023-02-16 17:01:27,446 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:27,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:27,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. after waiting 0 ms 2023-02-16 17:01:27,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:27,446 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676566881676.188a18d4a83aa31efed57f073fc3c3ca. 2023-02-16 17:01:27,447 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 188a18d4a83aa31efed57f073fc3c3ca: 2023-02-16 17:01:27,450 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:27,450 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:27,452 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:27,454 INFO [StoreOpener-4023075ec5bc920cad48017303aae017-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4023075ec5bc920cad48017303aae017 2023-02-16 17:01:27,455 DEBUG [StoreOpener-4023075ec5bc920cad48017303aae017-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f1 2023-02-16 17:01:27,455 INFO [StoreOpener-4023075ec5bc920cad48017303aae017-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4023075ec5bc920cad48017303aae017 columnFamilyName f1 2023-02-16 17:01:27,460 DEBUG [StoreOpener-4023075ec5bc920cad48017303aae017-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f1/testWithMapReduce=4023075ec5bc920cad48017303aae017-66c628ba24014eaeb043dddf4c35ab03 2023-02-16 17:01:27,460 INFO [StoreOpener-4023075ec5bc920cad48017303aae017-1] regionserver.HStore(310): Store=4023075ec5bc920cad48017303aae017/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,460 INFO [StoreOpener-4023075ec5bc920cad48017303aae017-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4023075ec5bc920cad48017303aae017 2023-02-16 17:01:27,461 DEBUG [StoreOpener-4023075ec5bc920cad48017303aae017-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f2 2023-02-16 17:01:27,461 INFO [StoreOpener-4023075ec5bc920cad48017303aae017-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4023075ec5bc920cad48017303aae017 columnFamilyName f2 2023-02-16 17:01:27,466 DEBUG [StoreOpener-4023075ec5bc920cad48017303aae017-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/4023075ec5bc920cad48017303aae017/f2/testWithMapReduce=4023075ec5bc920cad48017303aae017-f0137a60f9df4ed4a871cb2b2b0c8ee7 2023-02-16 17:01:27,466 INFO [StoreOpener-4023075ec5bc920cad48017303aae017-1] regionserver.HStore(310): Store=4023075ec5bc920cad48017303aae017/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:27,466 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4023075ec5bc920cad48017303aae017; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64418171, jitterRate=-0.04009445011615753}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:27,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4023075ec5bc920cad48017303aae017: 2023-02-16 17:01:27,513 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4023075ec5bc920cad48017303aae017, disabling compactions & flushes 2023-02-16 17:01:27,513 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:27,513 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:27,513 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. after waiting 0 ms 2023-02-16 17:01:27,513 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:27,514 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676566881676.4023075ec5bc920cad48017303aae017. 2023-02-16 17:01:27,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4023075ec5bc920cad48017303aae017: 2023-02-16 17:01:27,517 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:27,517 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:27,519 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:27,524 INFO [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:27,525 DEBUG [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f1 2023-02-16 17:01:27,525 INFO [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad1324f80ea4b890ddd8023ad0f192ee columnFamilyName f1 2023-02-16 17:01:27,530 DEBUG [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f1/testWithMapReduce=ad1324f80ea4b890ddd8023ad0f192ee-a19fce3a80d84040b1c6e7e26767595f 2023-02-16 17:01:27,530 INFO [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] regionserver.HStore(310): Store=ad1324f80ea4b890ddd8023ad0f192ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,531 INFO [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ad1324f80ea4b890ddd8023ad0f192ee 2023-02-16 17:01:27,531 DEBUG [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f2 2023-02-16 17:01:27,532 INFO [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad1324f80ea4b890ddd8023ad0f192ee columnFamilyName f2 2023-02-16 17:01:27,536 DEBUG [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/ad1324f80ea4b890ddd8023ad0f192ee/f2/testWithMapReduce=ad1324f80ea4b890ddd8023ad0f192ee-e5b04887724848f5ab1b40f46f7490a5 2023-02-16 17:01:27,536 INFO [StoreOpener-ad1324f80ea4b890ddd8023ad0f192ee-1] regionserver.HStore(310): Store=ad1324f80ea4b890ddd8023ad0f192ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,537 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:27,537 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ad1324f80ea4b890ddd8023ad0f192ee; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68742269, jitterRate=0.02433963119983673}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:27,537 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ad1324f80ea4b890ddd8023ad0f192ee: 2023-02-16 17:01:27,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ad1324f80ea4b890ddd8023ad0f192ee, disabling compactions & flushes 2023-02-16 17:01:27,565 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:27,565 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:27,565 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. after waiting 0 ms 2023-02-16 17:01:27,565 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:27,565 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676566881676.ad1324f80ea4b890ddd8023ad0f192ee. 2023-02-16 17:01:27,565 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ad1324f80ea4b890ddd8023ad0f192ee: 2023-02-16 17:01:27,569 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:27,569 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:27,570 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:27,572 INFO [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:27,574 DEBUG [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222/f1 2023-02-16 17:01:27,574 INFO [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aca79748b01eee0631c3c829c9d22222 columnFamilyName f1 2023-02-16 17:01:27,575 INFO [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] regionserver.HStore(310): Store=aca79748b01eee0631c3c829c9d22222/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,575 INFO [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aca79748b01eee0631c3c829c9d22222 2023-02-16 17:01:27,576 DEBUG [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/aca79748b01eee0631c3c829c9d22222/f2 2023-02-16 17:01:27,577 INFO [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aca79748b01eee0631c3c829c9d22222 columnFamilyName f2 2023-02-16 17:01:27,577 INFO [StoreOpener-aca79748b01eee0631c3c829c9d22222-1] regionserver.HStore(310): Store=aca79748b01eee0631c3c829c9d22222/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,577 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:27,578 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened aca79748b01eee0631c3c829c9d22222; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62173011, jitterRate=-0.07354994118213654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:27,578 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for aca79748b01eee0631c3c829c9d22222: 2023-02-16 17:01:27,595 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing aca79748b01eee0631c3c829c9d22222, disabling compactions & flushes 2023-02-16 17:01:27,595 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:27,595 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:27,595 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. after waiting 0 ms 2023-02-16 17:01:27,595 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:27,595 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676566881676.aca79748b01eee0631c3c829c9d22222. 2023-02-16 17:01:27,595 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for aca79748b01eee0631c3c829c9d22222: 2023-02-16 17:01:27,598 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:27,598 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:27,600 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:27,601 INFO [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:27,602 DEBUG [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f1 2023-02-16 17:01:27,603 INFO [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7276e6cb858090b97da96b3cd2751ce7 columnFamilyName f1 2023-02-16 17:01:27,607 DEBUG [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f1/testWithMapReduce=7276e6cb858090b97da96b3cd2751ce7-7f1a4e3fa61347faa9b1ae5b62530d2a 2023-02-16 17:01:27,607 INFO [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] regionserver.HStore(310): Store=7276e6cb858090b97da96b3cd2751ce7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,607 INFO [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7276e6cb858090b97da96b3cd2751ce7 2023-02-16 17:01:27,608 DEBUG [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f2 2023-02-16 17:01:27,608 INFO [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7276e6cb858090b97da96b3cd2751ce7 columnFamilyName f2 2023-02-16 17:01:27,612 DEBUG [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/7276e6cb858090b97da96b3cd2751ce7/f2/testWithMapReduce=7276e6cb858090b97da96b3cd2751ce7-c92109a89441461092566570e5b1407e 2023-02-16 17:01:27,613 INFO [StoreOpener-7276e6cb858090b97da96b3cd2751ce7-1] regionserver.HStore(310): Store=7276e6cb858090b97da96b3cd2751ce7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:27,613 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7276e6cb858090b97da96b3cd2751ce7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72538393, jitterRate=0.08090628683567047}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:27,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7276e6cb858090b97da96b3cd2751ce7: 2023-02-16 17:01:27,643 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7276e6cb858090b97da96b3cd2751ce7, disabling compactions & flushes 2023-02-16 17:01:27,643 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:27,643 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:27,643 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. after waiting 0 ms 2023-02-16 17:01:27,643 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:27,644 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676566881676.7276e6cb858090b97da96b3cd2751ce7. 2023-02-16 17:01:27,644 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7276e6cb858090b97da96b3cd2751ce7: 2023-02-16 17:01:27,647 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:27,647 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:27,648 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:27,650 INFO [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:27,651 DEBUG [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f1 2023-02-16 17:01:27,651 INFO [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e95d77046c122a566664ad82ef7297cb columnFamilyName f1 2023-02-16 17:01:27,656 DEBUG [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f1/testWithMapReduce=e95d77046c122a566664ad82ef7297cb-6628b7489594445495cf49d7250f7b5b 2023-02-16 17:01:27,656 INFO [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] regionserver.HStore(310): Store=e95d77046c122a566664ad82ef7297cb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,656 INFO [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e95d77046c122a566664ad82ef7297cb 2023-02-16 17:01:27,657 DEBUG [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f2 2023-02-16 17:01:27,657 INFO [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e95d77046c122a566664ad82ef7297cb columnFamilyName f2 2023-02-16 17:01:27,662 DEBUG [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/e95d77046c122a566664ad82ef7297cb/f2/testWithMapReduce=e95d77046c122a566664ad82ef7297cb-b5b9d5099b084a5c89d1520245e69f06 2023-02-16 17:01:27,662 INFO [StoreOpener-e95d77046c122a566664ad82ef7297cb-1] regionserver.HStore(310): Store=e95d77046c122a566664ad82ef7297cb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:27,662 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e95d77046c122a566664ad82ef7297cb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64495779, jitterRate=-0.0389380007982254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:27,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e95d77046c122a566664ad82ef7297cb: 2023-02-16 17:01:27,697 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e95d77046c122a566664ad82ef7297cb, disabling compactions & flushes 2023-02-16 17:01:27,697 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:27,698 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:27,698 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. after waiting 0 ms 2023-02-16 17:01:27,698 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:27,699 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676566881676.e95d77046c122a566664ad82ef7297cb. 2023-02-16 17:01:27,699 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e95d77046c122a566664ad82ef7297cb: 2023-02-16 17:01:27,703 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:27,703 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:27,704 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:27,706 INFO [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:27,707 DEBUG [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f1 2023-02-16 17:01:27,707 INFO [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58032a9cabb92e3926c24738e77cb25e columnFamilyName f1 2023-02-16 17:01:27,713 DEBUG [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f1/testWithMapReduce=58032a9cabb92e3926c24738e77cb25e-55040689030b4aa297506189da8c7ccd 2023-02-16 17:01:27,713 INFO [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] regionserver.HStore(310): Store=58032a9cabb92e3926c24738e77cb25e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,713 INFO [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 58032a9cabb92e3926c24738e77cb25e 2023-02-16 17:01:27,714 DEBUG [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f2 2023-02-16 17:01:27,714 INFO [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58032a9cabb92e3926c24738e77cb25e columnFamilyName f2 2023-02-16 17:01:27,719 DEBUG [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/58032a9cabb92e3926c24738e77cb25e/f2/testWithMapReduce=58032a9cabb92e3926c24738e77cb25e-209e316f0c0948c0862bb5c9746fb453 2023-02-16 17:01:27,719 INFO [StoreOpener-58032a9cabb92e3926c24738e77cb25e-1] regionserver.HStore(310): Store=58032a9cabb92e3926c24738e77cb25e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,720 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:27,720 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 58032a9cabb92e3926c24738e77cb25e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73670758, jitterRate=0.09777984023094177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:27,720 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 58032a9cabb92e3926c24738e77cb25e: 2023-02-16 17:01:27,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 58032a9cabb92e3926c24738e77cb25e, disabling compactions & flushes 2023-02-16 17:01:27,753 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:27,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:27,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. after waiting 0 ms 2023-02-16 17:01:27,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:27,756 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676566881676.58032a9cabb92e3926c24738e77cb25e. 2023-02-16 17:01:27,756 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 58032a9cabb92e3926c24738e77cb25e: 2023-02-16 17:01:27,758 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:27,759 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:27,760 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:27,762 INFO [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:27,763 DEBUG [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f1 2023-02-16 17:01:27,763 INFO [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58e5e6c9f4fc62b6d822876844eb0bb8 columnFamilyName f1 2023-02-16 17:01:27,770 DEBUG [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f1/testWithMapReduce=58e5e6c9f4fc62b6d822876844eb0bb8-eb6d19e1edea4ce8a1390bbb9ac8bfc2 2023-02-16 17:01:27,770 INFO [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] regionserver.HStore(310): Store=58e5e6c9f4fc62b6d822876844eb0bb8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,770 INFO [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 58e5e6c9f4fc62b6d822876844eb0bb8 2023-02-16 17:01:27,771 DEBUG [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f2 2023-02-16 17:01:27,771 INFO [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58e5e6c9f4fc62b6d822876844eb0bb8 columnFamilyName f2 2023-02-16 17:01:27,775 DEBUG [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/58e5e6c9f4fc62b6d822876844eb0bb8/f2/testWithMapReduce=58e5e6c9f4fc62b6d822876844eb0bb8-8d3d49ff9fb542178dfc855897685ccf 2023-02-16 17:01:27,775 INFO [StoreOpener-58e5e6c9f4fc62b6d822876844eb0bb8-1] regionserver.HStore(310): Store=58e5e6c9f4fc62b6d822876844eb0bb8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,776 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:27,776 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 58e5e6c9f4fc62b6d822876844eb0bb8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74362118, jitterRate=0.10808190703392029}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:27,776 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 58e5e6c9f4fc62b6d822876844eb0bb8: 2023-02-16 17:01:27,803 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 58e5e6c9f4fc62b6d822876844eb0bb8, disabling compactions & flushes 2023-02-16 17:01:27,803 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:27,803 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:27,803 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. after waiting 0 ms 2023-02-16 17:01:27,803 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:27,804 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676566881676.58e5e6c9f4fc62b6d822876844eb0bb8. 2023-02-16 17:01:27,804 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 58e5e6c9f4fc62b6d822876844eb0bb8: 2023-02-16 17:01:27,807 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:27,807 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:27,808 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:27,810 INFO [StoreOpener-875bff390fe68884baf037b513d266be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 875bff390fe68884baf037b513d266be 2023-02-16 17:01:27,811 DEBUG [StoreOpener-875bff390fe68884baf037b513d266be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f1 2023-02-16 17:01:27,811 INFO [StoreOpener-875bff390fe68884baf037b513d266be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 875bff390fe68884baf037b513d266be columnFamilyName f1 2023-02-16 17:01:27,816 DEBUG [StoreOpener-875bff390fe68884baf037b513d266be-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f1/testWithMapReduce=875bff390fe68884baf037b513d266be-afacd72debd749d9900ed8f2648aa0e8 2023-02-16 17:01:27,816 INFO [StoreOpener-875bff390fe68884baf037b513d266be-1] regionserver.HStore(310): Store=875bff390fe68884baf037b513d266be/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,816 INFO [StoreOpener-875bff390fe68884baf037b513d266be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 875bff390fe68884baf037b513d266be 2023-02-16 17:01:27,817 DEBUG [StoreOpener-875bff390fe68884baf037b513d266be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f2 2023-02-16 17:01:27,817 INFO [StoreOpener-875bff390fe68884baf037b513d266be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 875bff390fe68884baf037b513d266be columnFamilyName f2 2023-02-16 17:01:27,823 DEBUG [StoreOpener-875bff390fe68884baf037b513d266be-1] regionserver.HStore(539): loaded hdfs://localhost:41429/user/jenkins/test-data/cc262328-2af1-cd91-618f-bdbceec84df4/testWithMapReduceAndOfflineHBaseMultiRegion/d1678471-7dbd-4b9c-9a63-afa52846227e/data/default/testWithMapReduce/875bff390fe68884baf037b513d266be/f2/testWithMapReduce=875bff390fe68884baf037b513d266be-d13402fc0dba4afea67a554f9e94f423 2023-02-16 17:01:27,823 INFO [StoreOpener-875bff390fe68884baf037b513d266be-1] regionserver.HStore(310): Store=875bff390fe68884baf037b513d266be/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:27,823 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:27,824 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 875bff390fe68884baf037b513d266be; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64379758, jitterRate=-0.0406668484210968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:27,824 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 875bff390fe68884baf037b513d266be: 2023-02-16 17:01:27,859 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 875bff390fe68884baf037b513d266be, disabling compactions & flushes 2023-02-16 17:01:27,859 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:27,859 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:27,859 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. after waiting 0 ms 2023-02-16 17:01:27,859 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:27,860 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676566881676.875bff390fe68884baf037b513d266be. 2023-02-16 17:01:27,860 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 875bff390fe68884baf037b513d266be: 2023-02-16 17:01:28,090 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 17:01:28,370 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 17:01:28,370 WARN [Listener at localhost/41389] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:28,373 INFO [Listener at localhost/41389] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:28,476 WARN [BP-791395575-172.31.14.131-1676566879445 heartbeating to localhost/127.0.0.1:41429] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 17:01:28,476 WARN [BP-791395575-172.31.14.131-1676566879445 heartbeating to localhost/127.0.0.1:41429] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-791395575-172.31.14.131-1676566879445 (Datanode Uuid 8298649d-f274-46ab-b7dd-17c61ecad3b5) service to localhost/127.0.0.1:41429 2023-02-16 17:01:28,477 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/cluster_b2e49a4e-844a-74af-ab1f-6b345802eb22/dfs/data/data3/current/BP-791395575-172.31.14.131-1676566879445] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:28,477 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/cluster_b2e49a4e-844a-74af-ab1f-6b345802eb22/dfs/data/data4/current/BP-791395575-172.31.14.131-1676566879445] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:28,478 WARN [Listener at localhost/41389] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:28,481 INFO [Listener at localhost/41389] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:28,584 WARN [BP-791395575-172.31.14.131-1676566879445 heartbeating to localhost/127.0.0.1:41429] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 17:01:28,584 WARN [BP-791395575-172.31.14.131-1676566879445 heartbeating to localhost/127.0.0.1:41429] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-791395575-172.31.14.131-1676566879445 (Datanode Uuid a31600f4-efb5-4e45-8fb2-8bb1da65ec84) service to localhost/127.0.0.1:41429 2023-02-16 17:01:28,585 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/cluster_b2e49a4e-844a-74af-ab1f-6b345802eb22/dfs/data/data1/current/BP-791395575-172.31.14.131-1676566879445] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:28,586 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/cluster_b2e49a4e-844a-74af-ab1f-6b345802eb22/dfs/data/data2/current/BP-791395575-172.31.14.131-1676566879445] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:28,594 INFO [Listener at localhost/41389] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:28,714 INFO [Listener at localhost/41389] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 17:01:28,758 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 17:01:28,770 INFO [Listener at localhost/41389] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=156 (was 103) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:41429 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38729,1676566880205)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41389 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:41429 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:41429 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:41429 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41429 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:41429 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:41429 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=536 (was 533) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=325 (was 249) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1515 (was 1980) 2023-02-16 17:01:28,780 INFO [Listener at localhost/41389] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=156, OpenFileDescriptor=536, MaxFileDescriptor=60000, SystemLoadAverage=325, ProcessCount=169, AvailableMemoryMB=1515 2023-02-16 17:01:28,790 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/hadoop.log.dir so I do NOT create it in target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d 2023-02-16 17:01:28,791 WARN [Listener at localhost/41389] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 17:01:28,791 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/hadoop.tmp.dir so I do NOT create it in target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d 2023-02-16 17:01:28,791 WARN [Listener at localhost/41389] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b02b7dce-0efa-b853-581c-90e8da64cd37/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 17:01:28,791 DEBUG [Listener at localhost/41389] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d 2023-02-16 17:01:28,791 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 17:01:28,791 INFO [Listener at localhost/41389] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/cluster_86b1b406-89ba-7da5-146e-5fa4642be4a3, deleteOnExit=true 2023-02-16 17:01:28,791 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 17:01:28,791 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/test.cache.data in system properties and HBase conf 2023-02-16 17:01:28,791 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 17:01:28,791 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/hadoop.log.dir in system properties and HBase conf 2023-02-16 17:01:28,791 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 17:01:28,792 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 17:01:28,792 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 17:01:28,792 DEBUG [Listener at localhost/41389] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 17:01:28,792 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:01:28,792 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:01:28,792 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 17:01:28,792 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:01:28,792 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 17:01:28,792 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 17:01:28,793 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:01:28,793 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:01:28,793 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 17:01:28,793 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/nfs.dump.dir in system properties and HBase conf 2023-02-16 17:01:28,793 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/java.io.tmpdir in system properties and HBase conf 2023-02-16 17:01:28,793 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:01:28,793 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 17:01:28,793 INFO [Listener at localhost/41389] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 17:01:28,799 WARN [Listener at localhost/41389] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:01:28,799 WARN [Listener at localhost/41389] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:01:28,844 WARN [Listener at localhost/41389] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:28,846 INFO [Listener at localhost/41389] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:28,853 INFO [Listener at localhost/41389] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/java.io.tmpdir/Jetty_localhost_40675_hdfs____.luamym/webapp 2023-02-16 17:01:28,970 INFO [Listener at localhost/41389] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40675 2023-02-16 17:01:28,975 WARN [Listener at localhost/41389] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:01:28,975 WARN [Listener at localhost/41389] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:01:29,016 WARN [Listener at localhost/37829] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:29,025 WARN [Listener at localhost/37829] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:29,027 WARN [Listener at localhost/37829] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:29,028 INFO [Listener at localhost/37829] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:29,034 INFO [Listener at localhost/37829] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/java.io.tmpdir/Jetty_localhost_44789_datanode____.rp5ijl/webapp 2023-02-16 17:01:29,136 INFO [Listener at localhost/37829] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44789 2023-02-16 17:01:29,144 WARN [Listener at localhost/38563] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:29,168 WARN [Listener at localhost/38563] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:29,171 WARN [Listener at localhost/38563] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:29,172 INFO [Listener at localhost/38563] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:29,176 INFO [Listener at localhost/38563] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/java.io.tmpdir/Jetty_localhost_34331_datanode____1ugomv/webapp 2023-02-16 17:01:29,277 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfbdac7c77f367449: Processing first storage report for DS-78a86b71-b3b5-4a65-b7ec-fbf76d4629fd from datanode c4e222a2-2408-43ef-9118-b3f85bb80de9 2023-02-16 17:01:29,277 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfbdac7c77f367449: from storage DS-78a86b71-b3b5-4a65-b7ec-fbf76d4629fd node DatanodeRegistration(127.0.0.1:33183, datanodeUuid=c4e222a2-2408-43ef-9118-b3f85bb80de9, infoPort=45867, infoSecurePort=0, ipcPort=38563, storageInfo=lv=-57;cid=testClusterID;nsid=1829403113;c=1676566888803), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:29,277 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfbdac7c77f367449: Processing first storage report for DS-61a9ec51-946d-4c9e-a3d4-f933fc1daf53 from datanode c4e222a2-2408-43ef-9118-b3f85bb80de9 2023-02-16 17:01:29,277 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfbdac7c77f367449: from storage DS-61a9ec51-946d-4c9e-a3d4-f933fc1daf53 node DatanodeRegistration(127.0.0.1:33183, datanodeUuid=c4e222a2-2408-43ef-9118-b3f85bb80de9, infoPort=45867, infoSecurePort=0, ipcPort=38563, storageInfo=lv=-57;cid=testClusterID;nsid=1829403113;c=1676566888803), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:29,291 INFO [Listener at localhost/38563] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34331 2023-02-16 17:01:29,298 WARN [Listener at localhost/37813] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:29,381 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x22a390d988b4a5a5: Processing first storage report for DS-3b1be21d-8b2e-498f-8aed-6a703e39b218 from datanode f77fd786-831d-4f5a-864d-c11bebc1c482 2023-02-16 17:01:29,381 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x22a390d988b4a5a5: from storage DS-3b1be21d-8b2e-498f-8aed-6a703e39b218 node DatanodeRegistration(127.0.0.1:45979, datanodeUuid=f77fd786-831d-4f5a-864d-c11bebc1c482, infoPort=42133, infoSecurePort=0, ipcPort=37813, storageInfo=lv=-57;cid=testClusterID;nsid=1829403113;c=1676566888803), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:29,382 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x22a390d988b4a5a5: Processing first storage report for DS-8724abe3-c92f-4d7f-9bd3-d2d582c0a0c2 from datanode f77fd786-831d-4f5a-864d-c11bebc1c482 2023-02-16 17:01:29,382 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x22a390d988b4a5a5: from storage DS-8724abe3-c92f-4d7f-9bd3-d2d582c0a0c2 node DatanodeRegistration(127.0.0.1:45979, datanodeUuid=f77fd786-831d-4f5a-864d-c11bebc1c482, infoPort=42133, infoSecurePort=0, ipcPort=37813, storageInfo=lv=-57;cid=testClusterID;nsid=1829403113;c=1676566888803), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:29,404 DEBUG [Listener at localhost/37813] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d 2023-02-16 17:01:29,406 INFO [Listener at localhost/37813] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/cluster_86b1b406-89ba-7da5-146e-5fa4642be4a3/zookeeper_0, clientPort=60229, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/cluster_86b1b406-89ba-7da5-146e-5fa4642be4a3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/cluster_86b1b406-89ba-7da5-146e-5fa4642be4a3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 17:01:29,407 INFO [Listener at localhost/37813] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60229 2023-02-16 17:01:29,407 INFO [Listener at localhost/37813] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:29,408 INFO [Listener at localhost/37813] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:29,419 INFO [Listener at localhost/37813] util.FSUtils(479): Created version file at hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec with version=8 2023-02-16 17:01:29,419 INFO [Listener at localhost/37813] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:29,420 INFO [Listener at localhost/37813] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:29,420 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37829/user/jenkins/test-data/b6bf8466-0cbe-d877-3a3a-69bf11c5fcef/hbase-staging 2023-02-16 17:01:29,422 INFO [Listener at localhost/37813] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:29,422 INFO [Listener at localhost/37813] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:29,422 INFO [Listener at localhost/37813] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:29,422 INFO [Listener at localhost/37813] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:29,423 INFO [Listener at localhost/37813] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:29,423 INFO [Listener at localhost/37813] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:29,423 INFO [Listener at localhost/37813] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:29,424 INFO [Listener at localhost/37813] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39537 2023-02-16 17:01:29,424 INFO [Listener at localhost/37813] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:29,425 INFO [Listener at localhost/37813] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:29,426 INFO [Listener at localhost/37813] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39537 connecting to ZooKeeper ensemble=127.0.0.1:60229 2023-02-16 17:01:29,433 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:395370x0, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:29,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39537-0x1005e146d820000 connected 2023-02-16 17:01:29,446 DEBUG [Listener at localhost/37813] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:29,447 DEBUG [Listener at localhost/37813] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:29,447 DEBUG [Listener at localhost/37813] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:29,447 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39537 2023-02-16 17:01:29,448 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39537 2023-02-16 17:01:29,448 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39537 2023-02-16 17:01:29,448 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39537 2023-02-16 17:01:29,448 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39537 2023-02-16 17:01:29,449 INFO [Listener at localhost/37813] master.HMaster(444): hbase.rootdir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec, hbase.cluster.distributed=false 2023-02-16 17:01:29,461 INFO [Listener at localhost/37813] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:29,461 INFO [Listener at localhost/37813] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:29,461 INFO [Listener at localhost/37813] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:29,461 INFO [Listener at localhost/37813] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:29,461 INFO [Listener at localhost/37813] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:29,461 INFO [Listener at localhost/37813] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:29,461 INFO [Listener at localhost/37813] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:29,463 INFO [Listener at localhost/37813] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45407 2023-02-16 17:01:29,463 INFO [Listener at localhost/37813] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:29,464 DEBUG [Listener at localhost/37813] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:29,464 INFO [Listener at localhost/37813] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:29,465 INFO [Listener at localhost/37813] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:29,467 INFO [Listener at localhost/37813] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45407 connecting to ZooKeeper ensemble=127.0.0.1:60229 2023-02-16 17:01:29,470 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:454070x0, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:29,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45407-0x1005e146d820001 connected 2023-02-16 17:01:29,472 DEBUG [Listener at localhost/37813] zookeeper.ZKUtil(164): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:29,472 DEBUG [Listener at localhost/37813] zookeeper.ZKUtil(164): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:29,473 DEBUG [Listener at localhost/37813] zookeeper.ZKUtil(164): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:29,475 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45407 2023-02-16 17:01:29,475 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45407 2023-02-16 17:01:29,480 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45407 2023-02-16 17:01:29,480 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45407 2023-02-16 17:01:29,480 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45407 2023-02-16 17:01:29,491 INFO [Listener at localhost/37813] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:29,492 INFO [Listener at localhost/37813] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:29,492 INFO [Listener at localhost/37813] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:29,492 INFO [Listener at localhost/37813] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:29,492 INFO [Listener at localhost/37813] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:29,492 INFO [Listener at localhost/37813] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:29,492 INFO [Listener at localhost/37813] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:29,493 INFO [Listener at localhost/37813] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38773 2023-02-16 17:01:29,494 INFO [Listener at localhost/37813] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:29,495 DEBUG [Listener at localhost/37813] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:29,495 INFO [Listener at localhost/37813] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:29,496 INFO [Listener at localhost/37813] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:29,497 INFO [Listener at localhost/37813] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38773 connecting to ZooKeeper ensemble=127.0.0.1:60229 2023-02-16 17:01:29,499 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:387730x0, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:29,501 DEBUG [Listener at localhost/37813] zookeeper.ZKUtil(164): regionserver:387730x0, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:29,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38773-0x1005e146d820002 connected 2023-02-16 17:01:29,502 DEBUG [Listener at localhost/37813] zookeeper.ZKUtil(164): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:29,502 DEBUG [Listener at localhost/37813] zookeeper.ZKUtil(164): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:29,503 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38773 2023-02-16 17:01:29,503 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38773 2023-02-16 17:01:29,503 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38773 2023-02-16 17:01:29,503 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38773 2023-02-16 17:01:29,503 DEBUG [Listener at localhost/37813] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38773 2023-02-16 17:01:29,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39537,1676566889422 2023-02-16 17:01:29,507 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:29,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39537,1676566889422 2023-02-16 17:01:29,508 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:29,508 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:29,508 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:29,509 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:29,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:29,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39537,1676566889422 from backup master directory 2023-02-16 17:01:29,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:29,511 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39537,1676566889422 2023-02-16 17:01:29,511 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:29,511 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:29,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39537,1676566889422 2023-02-16 17:01:29,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/hbase.id with ID: 4c3855be-6d81-4fbc-90b2-b6242c1904f7 2023-02-16 17:01:29,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:29,534 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:29,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x75dd4e8c to 127.0.0.1:60229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:29,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a04f507, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:29,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:29,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 17:01:29,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:29,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/data/master/store-tmp 2023-02-16 17:01:29,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:29,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:29,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:29,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:29,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:29,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:29,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:29,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:29,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/WALs/jenkins-hbase4.apache.org,39537,1676566889422 2023-02-16 17:01:29,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39537%2C1676566889422, suffix=, logDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/WALs/jenkins-hbase4.apache.org,39537,1676566889422, archiveDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/oldWALs, maxLogs=10 2023-02-16 17:01:29,580 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33183,DS-78a86b71-b3b5-4a65-b7ec-fbf76d4629fd,DISK] 2023-02-16 17:01:29,580 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45979,DS-3b1be21d-8b2e-498f-8aed-6a703e39b218,DISK] 2023-02-16 17:01:29,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/WALs/jenkins-hbase4.apache.org,39537,1676566889422/jenkins-hbase4.apache.org%2C39537%2C1676566889422.1676566889564 2023-02-16 17:01:29,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33183,DS-78a86b71-b3b5-4a65-b7ec-fbf76d4629fd,DISK], DatanodeInfoWithStorage[127.0.0.1:45979,DS-3b1be21d-8b2e-498f-8aed-6a703e39b218,DISK]] 2023-02-16 17:01:29,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:29,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:29,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:29,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:29,583 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:29,585 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 17:01:29,585 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 17:01:29,585 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:29,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:29,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:29,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:29,590 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:29,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60938632, jitterRate=-0.09194362163543701}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:29,590 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:29,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 17:01:29,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 17:01:29,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 17:01:29,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 17:01:29,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 17:01:29,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 17:01:29,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 17:01:29,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 17:01:29,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 17:01:29,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 17:01:29,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 17:01:29,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 17:01:29,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 17:01:29,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 17:01:29,607 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:29,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 17:01:29,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 17:01:29,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 17:01:29,610 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:29,610 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:29,610 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:29,610 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:29,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39537,1676566889422, sessionid=0x1005e146d820000, setting cluster-up flag (Was=false) 2023-02-16 17:01:29,616 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:29,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 17:01:29,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39537,1676566889422 2023-02-16 17:01:29,625 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:29,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 17:01:29,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39537,1676566889422 2023-02-16 17:01:29,633 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.hbase-snapshot/.tmp 2023-02-16 17:01:29,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:29,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:29,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:29,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:29,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:29,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 17:01:29,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:29,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,648 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:29,648 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 17:01:29,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676566919648 2023-02-16 17:01:29,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 17:01:29,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 17:01:29,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 17:01:29,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 17:01:29,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 17:01:29,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 17:01:29,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 17:01:29,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 17:01:29,650 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:29,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 17:01:29,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 17:01:29,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 17:01:29,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566889651,5,FailOnTimeoutGroup] 2023-02-16 17:01:29,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566889651,5,FailOnTimeoutGroup] 2023-02-16 17:01:29,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 17:01:29,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,663 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:29,663 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:29,663 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec 2023-02-16 17:01:29,669 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:29,670 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:29,671 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/info 2023-02-16 17:01:29,671 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:29,672 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:29,672 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:29,673 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:29,673 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:29,674 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:29,674 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:29,675 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/table 2023-02-16 17:01:29,675 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:29,675 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:29,676 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740 2023-02-16 17:01:29,676 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740 2023-02-16 17:01:29,678 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:29,679 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:29,680 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:29,680 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66406118, jitterRate=-0.010471731424331665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:29,681 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:29,681 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:29,681 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:29,681 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:29,681 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:29,681 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:29,681 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:29,681 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:29,682 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:29,682 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 17:01:29,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 17:01:29,684 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 17:01:29,685 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 17:01:29,705 INFO [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(952): ClusterId : 4c3855be-6d81-4fbc-90b2-b6242c1904f7 2023-02-16 17:01:29,705 INFO [RS:0;jenkins-hbase4:45407] regionserver.HRegionServer(952): ClusterId : 4c3855be-6d81-4fbc-90b2-b6242c1904f7 2023-02-16 17:01:29,705 DEBUG [RS:1;jenkins-hbase4:38773] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:29,705 DEBUG [RS:0;jenkins-hbase4:45407] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:29,707 DEBUG [RS:1;jenkins-hbase4:38773] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:29,707 DEBUG [RS:0;jenkins-hbase4:45407] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:29,707 DEBUG [RS:0;jenkins-hbase4:45407] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:29,707 DEBUG [RS:1;jenkins-hbase4:38773] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:29,710 DEBUG [RS:0;jenkins-hbase4:45407] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:29,710 DEBUG [RS:0;jenkins-hbase4:45407] zookeeper.ReadOnlyZKClient(139): Connect 0x23fc6d6d to 127.0.0.1:60229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:29,710 DEBUG [RS:1;jenkins-hbase4:38773] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:29,711 DEBUG [RS:1;jenkins-hbase4:38773] zookeeper.ReadOnlyZKClient(139): Connect 0x2c207ddf to 127.0.0.1:60229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:29,717 DEBUG [RS:0;jenkins-hbase4:45407] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d3b8762, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:29,718 DEBUG [RS:0;jenkins-hbase4:45407] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2904061d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:29,718 DEBUG [RS:1;jenkins-hbase4:38773] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22e7962b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:29,718 DEBUG [RS:1;jenkins-hbase4:38773] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26d816af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:29,727 DEBUG [RS:1;jenkins-hbase4:38773] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38773 2023-02-16 17:01:29,727 INFO [RS:1;jenkins-hbase4:38773] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:29,727 INFO [RS:1;jenkins-hbase4:38773] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:29,727 DEBUG [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:29,727 DEBUG [RS:0;jenkins-hbase4:45407] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45407 2023-02-16 17:01:29,727 INFO [RS:0;jenkins-hbase4:45407] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:29,727 INFO [RS:0;jenkins-hbase4:45407] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:29,727 DEBUG [RS:0;jenkins-hbase4:45407] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:29,727 INFO [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39537,1676566889422 with isa=jenkins-hbase4.apache.org/172.31.14.131:38773, startcode=1676566889491 2023-02-16 17:01:29,727 INFO [RS:0;jenkins-hbase4:45407] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39537,1676566889422 with isa=jenkins-hbase4.apache.org/172.31.14.131:45407, startcode=1676566889461 2023-02-16 17:01:29,727 DEBUG [RS:1;jenkins-hbase4:38773] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:29,727 DEBUG [RS:0;jenkins-hbase4:45407] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:29,729 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42875, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:29,730 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35479, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:29,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39537] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:29,731 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:29,731 DEBUG [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec 2023-02-16 17:01:29,732 DEBUG [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37829 2023-02-16 17:01:29,732 DEBUG [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:29,732 DEBUG [RS:0;jenkins-hbase4:45407] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec 2023-02-16 17:01:29,732 DEBUG [RS:0;jenkins-hbase4:45407] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37829 2023-02-16 17:01:29,732 DEBUG [RS:0;jenkins-hbase4:45407] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:29,733 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:29,740 DEBUG [RS:1;jenkins-hbase4:38773] zookeeper.ZKUtil(162): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:29,740 WARN [RS:1;jenkins-hbase4:38773] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:29,740 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38773,1676566889491] 2023-02-16 17:01:29,740 INFO [RS:1;jenkins-hbase4:38773] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:29,740 DEBUG [RS:0;jenkins-hbase4:45407] zookeeper.ZKUtil(162): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:29,740 DEBUG [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/WALs/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:29,740 WARN [RS:0;jenkins-hbase4:45407] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:29,740 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45407,1676566889461] 2023-02-16 17:01:29,740 INFO [RS:0;jenkins-hbase4:45407] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:29,740 DEBUG [RS:0;jenkins-hbase4:45407] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/WALs/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:29,745 DEBUG [RS:0;jenkins-hbase4:45407] zookeeper.ZKUtil(162): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:29,745 DEBUG [RS:1;jenkins-hbase4:38773] zookeeper.ZKUtil(162): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:29,745 DEBUG [RS:0;jenkins-hbase4:45407] zookeeper.ZKUtil(162): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:29,745 DEBUG [RS:1;jenkins-hbase4:38773] zookeeper.ZKUtil(162): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:29,746 DEBUG [RS:0;jenkins-hbase4:45407] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:29,746 DEBUG [RS:1;jenkins-hbase4:38773] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:29,746 INFO [RS:0;jenkins-hbase4:45407] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:29,746 INFO [RS:1;jenkins-hbase4:38773] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:29,747 INFO [RS:0;jenkins-hbase4:45407] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:29,748 INFO [RS:0;jenkins-hbase4:45407] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:29,748 INFO [RS:0;jenkins-hbase4:45407] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,748 INFO [RS:0;jenkins-hbase4:45407] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:29,752 INFO [RS:1;jenkins-hbase4:38773] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:29,752 INFO [RS:0;jenkins-hbase4:45407] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,752 INFO [RS:1;jenkins-hbase4:38773] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:29,753 INFO [RS:1;jenkins-hbase4:38773] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,753 DEBUG [RS:0;jenkins-hbase4:45407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,753 DEBUG [RS:0;jenkins-hbase4:45407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,753 DEBUG [RS:0;jenkins-hbase4:45407] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,753 DEBUG [RS:0;jenkins-hbase4:45407] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,753 DEBUG [RS:0;jenkins-hbase4:45407] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,753 DEBUG [RS:0;jenkins-hbase4:45407] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:29,753 DEBUG [RS:0;jenkins-hbase4:45407] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,753 DEBUG [RS:0;jenkins-hbase4:45407] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,753 DEBUG [RS:0;jenkins-hbase4:45407] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,753 DEBUG [RS:0;jenkins-hbase4:45407] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,754 INFO [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:29,755 INFO [RS:0;jenkins-hbase4:45407] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,755 INFO [RS:0;jenkins-hbase4:45407] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,756 INFO [RS:0;jenkins-hbase4:45407] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,756 INFO [RS:1;jenkins-hbase4:38773] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,756 DEBUG [RS:1;jenkins-hbase4:38773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,756 DEBUG [RS:1;jenkins-hbase4:38773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,756 DEBUG [RS:1;jenkins-hbase4:38773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,756 DEBUG [RS:1;jenkins-hbase4:38773] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,756 DEBUG [RS:1;jenkins-hbase4:38773] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,756 DEBUG [RS:1;jenkins-hbase4:38773] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:29,756 DEBUG [RS:1;jenkins-hbase4:38773] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,756 DEBUG [RS:1;jenkins-hbase4:38773] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,756 DEBUG [RS:1;jenkins-hbase4:38773] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,756 DEBUG [RS:1;jenkins-hbase4:38773] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:29,761 INFO [RS:1;jenkins-hbase4:38773] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,761 INFO [RS:1;jenkins-hbase4:38773] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,761 INFO [RS:1;jenkins-hbase4:38773] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,771 INFO [RS:0;jenkins-hbase4:45407] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:29,771 INFO [RS:0;jenkins-hbase4:45407] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45407,1676566889461-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,771 INFO [RS:1;jenkins-hbase4:38773] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:29,772 INFO [RS:1;jenkins-hbase4:38773] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38773,1676566889491-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:29,781 INFO [RS:0;jenkins-hbase4:45407] regionserver.Replication(203): jenkins-hbase4.apache.org,45407,1676566889461 started 2023-02-16 17:01:29,781 INFO [RS:0;jenkins-hbase4:45407] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45407,1676566889461, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45407, sessionid=0x1005e146d820001 2023-02-16 17:01:29,781 DEBUG [RS:0;jenkins-hbase4:45407] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:29,781 DEBUG [RS:0;jenkins-hbase4:45407] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:29,781 DEBUG [RS:0;jenkins-hbase4:45407] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45407,1676566889461' 2023-02-16 17:01:29,781 DEBUG [RS:0;jenkins-hbase4:45407] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:29,782 DEBUG [RS:0;jenkins-hbase4:45407] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:29,782 INFO [RS:1;jenkins-hbase4:38773] regionserver.Replication(203): jenkins-hbase4.apache.org,38773,1676566889491 started 2023-02-16 17:01:29,782 INFO [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38773,1676566889491, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38773, sessionid=0x1005e146d820002 2023-02-16 17:01:29,782 DEBUG [RS:0;jenkins-hbase4:45407] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:29,782 DEBUG [RS:1;jenkins-hbase4:38773] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:29,782 DEBUG [RS:1;jenkins-hbase4:38773] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:29,782 DEBUG [RS:0;jenkins-hbase4:45407] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:29,782 DEBUG [RS:1;jenkins-hbase4:38773] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38773,1676566889491' 2023-02-16 17:01:29,782 DEBUG [RS:1;jenkins-hbase4:38773] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:29,782 DEBUG [RS:0;jenkins-hbase4:45407] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:29,782 DEBUG [RS:0;jenkins-hbase4:45407] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45407,1676566889461' 2023-02-16 17:01:29,782 DEBUG [RS:0;jenkins-hbase4:45407] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:29,782 DEBUG [RS:1;jenkins-hbase4:38773] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:29,782 DEBUG [RS:0;jenkins-hbase4:45407] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:29,783 DEBUG [RS:1;jenkins-hbase4:38773] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:29,783 DEBUG [RS:1;jenkins-hbase4:38773] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:29,783 DEBUG [RS:1;jenkins-hbase4:38773] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:29,783 DEBUG [RS:1;jenkins-hbase4:38773] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38773,1676566889491' 2023-02-16 17:01:29,783 DEBUG [RS:1;jenkins-hbase4:38773] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:29,783 DEBUG [RS:0;jenkins-hbase4:45407] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:29,783 INFO [RS:0;jenkins-hbase4:45407] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:29,783 INFO [RS:0;jenkins-hbase4:45407] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:29,783 DEBUG [RS:1;jenkins-hbase4:38773] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:29,783 DEBUG [RS:1;jenkins-hbase4:38773] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:29,783 INFO [RS:1;jenkins-hbase4:38773] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:29,783 INFO [RS:1;jenkins-hbase4:38773] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:29,835 DEBUG [jenkins-hbase4:39537] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 17:01:29,835 DEBUG [jenkins-hbase4:39537] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:29,837 DEBUG [jenkins-hbase4:39537] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:29,837 DEBUG [jenkins-hbase4:39537] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:29,837 DEBUG [jenkins-hbase4:39537] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:29,838 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38773,1676566889491, state=OPENING 2023-02-16 17:01:29,839 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 17:01:29,840 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:29,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38773,1676566889491}] 2023-02-16 17:01:29,841 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:29,995 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:29,995 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:29,997 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:30,024 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 17:01:30,024 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:30,027 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38773%2C1676566889491.meta, suffix=.meta, logDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/WALs/jenkins-hbase4.apache.org,38773,1676566889491, archiveDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/oldWALs, maxLogs=32 2023-02-16 17:01:30,048 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45979,DS-3b1be21d-8b2e-498f-8aed-6a703e39b218,DISK] 2023-02-16 17:01:30,048 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33183,DS-78a86b71-b3b5-4a65-b7ec-fbf76d4629fd,DISK] 2023-02-16 17:01:30,051 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/WALs/jenkins-hbase4.apache.org,38773,1676566889491/jenkins-hbase4.apache.org%2C38773%2C1676566889491.meta.1676566890028.meta 2023-02-16 17:01:30,064 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33183,DS-78a86b71-b3b5-4a65-b7ec-fbf76d4629fd,DISK], DatanodeInfoWithStorage[127.0.0.1:45979,DS-3b1be21d-8b2e-498f-8aed-6a703e39b218,DISK]] 2023-02-16 17:01:30,064 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:30,064 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 17:01:30,065 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 17:01:30,065 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 17:01:30,065 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 17:01:30,065 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:30,065 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 17:01:30,065 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 17:01:30,068 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:30,070 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/info 2023-02-16 17:01:30,070 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/info 2023-02-16 17:01:30,071 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:30,071 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:30,072 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:30,073 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:30,073 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:30,073 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:30,074 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:30,074 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:30,075 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/table 2023-02-16 17:01:30,075 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/table 2023-02-16 17:01:30,075 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:30,077 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:30,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740 2023-02-16 17:01:30,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740 2023-02-16 17:01:30,083 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:30,085 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:30,086 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68909229, jitterRate=0.026827529072761536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:30,086 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:30,087 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676566889995 2023-02-16 17:01:30,093 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 17:01:30,094 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 17:01:30,094 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38773,1676566889491, state=OPEN 2023-02-16 17:01:30,095 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 17:01:30,095 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:30,097 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 17:01:30,097 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38773,1676566889491 in 255 msec 2023-02-16 17:01:30,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 17:01:30,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 415 msec 2023-02-16 17:01:30,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 466 msec 2023-02-16 17:01:30,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676566890100, completionTime=-1 2023-02-16 17:01:30,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 17:01:30,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 17:01:30,104 DEBUG [hconnection-0x7d918d6d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:30,105 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43908, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:30,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 17:01:30,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676566950106 2023-02-16 17:01:30,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676567010107 2023-02-16 17:01:30,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-16 17:01:30,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39537,1676566889422-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:30,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39537,1676566889422-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:30,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39537,1676566889422-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:30,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39537, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:30,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:30,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 17:01:30,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:30,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 17:01:30,117 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 17:01:30,117 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:30,118 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:30,119 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/hbase/namespace/db0020a04787e12708bbbd7b68519764 2023-02-16 17:01:30,120 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/hbase/namespace/db0020a04787e12708bbbd7b68519764 empty. 2023-02-16 17:01:30,120 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/hbase/namespace/db0020a04787e12708bbbd7b68519764 2023-02-16 17:01:30,120 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 17:01:30,130 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:30,131 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => db0020a04787e12708bbbd7b68519764, NAME => 'hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp 2023-02-16 17:01:30,137 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:30,137 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing db0020a04787e12708bbbd7b68519764, disabling compactions & flushes 2023-02-16 17:01:30,137 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. 2023-02-16 17:01:30,137 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. 2023-02-16 17:01:30,137 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. after waiting 0 ms 2023-02-16 17:01:30,137 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. 2023-02-16 17:01:30,137 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. 2023-02-16 17:01:30,137 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for db0020a04787e12708bbbd7b68519764: 2023-02-16 17:01:30,139 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:30,140 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566890139"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566890139"}]},"ts":"1676566890139"} 2023-02-16 17:01:30,141 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 17:01:30,142 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:30,142 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566890142"}]},"ts":"1676566890142"} 2023-02-16 17:01:30,143 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 17:01:30,146 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:30,147 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:30,147 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:30,147 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:30,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=db0020a04787e12708bbbd7b68519764, ASSIGN}] 2023-02-16 17:01:30,149 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=db0020a04787e12708bbbd7b68519764, ASSIGN 2023-02-16 17:01:30,149 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=db0020a04787e12708bbbd7b68519764, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38773,1676566889491; forceNewPlan=false, retain=false 2023-02-16 17:01:30,300 INFO [jenkins-hbase4:39537] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 17:01:30,301 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=db0020a04787e12708bbbd7b68519764, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:30,301 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566890301"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566890301"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566890301"}]},"ts":"1676566890301"} 2023-02-16 17:01:30,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure db0020a04787e12708bbbd7b68519764, server=jenkins-hbase4.apache.org,38773,1676566889491}] 2023-02-16 17:01:30,458 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. 2023-02-16 17:01:30,460 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38773%2C1676566889491, suffix=, logDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/WALs/jenkins-hbase4.apache.org,38773,1676566889491, archiveDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/oldWALs, maxLogs=32 2023-02-16 17:01:30,475 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45979,DS-3b1be21d-8b2e-498f-8aed-6a703e39b218,DISK] 2023-02-16 17:01:30,476 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33183,DS-78a86b71-b3b5-4a65-b7ec-fbf76d4629fd,DISK] 2023-02-16 17:01:30,478 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/WALs/jenkins-hbase4.apache.org,38773,1676566889491/jenkins-hbase4.apache.org%2C38773%2C1676566889491.1676566890461 2023-02-16 17:01:30,479 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45979,DS-3b1be21d-8b2e-498f-8aed-6a703e39b218,DISK], DatanodeInfoWithStorage[127.0.0.1:33183,DS-78a86b71-b3b5-4a65-b7ec-fbf76d4629fd,DISK]] 2023-02-16 17:01:30,479 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => db0020a04787e12708bbbd7b68519764, NAME => 'hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:30,479 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace db0020a04787e12708bbbd7b68519764 2023-02-16 17:01:30,479 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:30,479 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for db0020a04787e12708bbbd7b68519764 2023-02-16 17:01:30,479 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for db0020a04787e12708bbbd7b68519764 2023-02-16 17:01:30,483 INFO [StoreOpener-db0020a04787e12708bbbd7b68519764-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region db0020a04787e12708bbbd7b68519764 2023-02-16 17:01:30,485 DEBUG [StoreOpener-db0020a04787e12708bbbd7b68519764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/namespace/db0020a04787e12708bbbd7b68519764/info 2023-02-16 17:01:30,485 DEBUG [StoreOpener-db0020a04787e12708bbbd7b68519764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/namespace/db0020a04787e12708bbbd7b68519764/info 2023-02-16 17:01:30,485 INFO [StoreOpener-db0020a04787e12708bbbd7b68519764-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db0020a04787e12708bbbd7b68519764 columnFamilyName info 2023-02-16 17:01:30,486 INFO [StoreOpener-db0020a04787e12708bbbd7b68519764-1] regionserver.HStore(310): Store=db0020a04787e12708bbbd7b68519764/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:30,486 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/namespace/db0020a04787e12708bbbd7b68519764 2023-02-16 17:01:30,487 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/namespace/db0020a04787e12708bbbd7b68519764 2023-02-16 17:01:30,489 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for db0020a04787e12708bbbd7b68519764 2023-02-16 17:01:30,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/namespace/db0020a04787e12708bbbd7b68519764/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:30,492 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened db0020a04787e12708bbbd7b68519764; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59667562, jitterRate=-0.11088404059410095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:30,492 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for db0020a04787e12708bbbd7b68519764: 2023-02-16 17:01:30,493 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764., pid=6, masterSystemTime=1676566890455 2023-02-16 17:01:30,494 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. 2023-02-16 17:01:30,494 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. 2023-02-16 17:01:30,495 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=db0020a04787e12708bbbd7b68519764, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:30,495 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566890495"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566890495"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566890495"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566890495"}]},"ts":"1676566890495"} 2023-02-16 17:01:30,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 17:01:30,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure db0020a04787e12708bbbd7b68519764, server=jenkins-hbase4.apache.org,38773,1676566889491 in 193 msec 2023-02-16 17:01:30,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 17:01:30,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=db0020a04787e12708bbbd7b68519764, ASSIGN in 351 msec 2023-02-16 17:01:30,500 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:30,501 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566890500"}]},"ts":"1676566890500"} 2023-02-16 17:01:30,502 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 17:01:30,505 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:30,506 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 390 msec 2023-02-16 17:01:30,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 17:01:30,518 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:30,518 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:30,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 17:01:30,529 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:30,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-16 17:01:30,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 17:01:30,541 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:30,544 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-16 17:01:30,563 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 17:01:30,567 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 17:01:30,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.056sec 2023-02-16 17:01:30,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 17:01:30,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 17:01:30,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 17:01:30,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39537,1676566889422-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 17:01:30,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39537,1676566889422-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 17:01:30,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 17:01:30,606 DEBUG [Listener at localhost/37813] zookeeper.ReadOnlyZKClient(139): Connect 0x368aba8b to 127.0.0.1:60229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:30,613 DEBUG [Listener at localhost/37813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bd65069, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:30,614 DEBUG [hconnection-0x688f6ef3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:30,617 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43910, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:30,619 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39537,1676566889422 2023-02-16 17:01:30,619 DEBUG [Listener at localhost/37813] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 17:01:30,622 DEBUG [Listener at localhost/37813] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 17:01:30,624 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58050, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 17:01:30,625 INFO [Listener at localhost/37813] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:30,625 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:30,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 17:01:30,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:58050 deadline: 1676566950625, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:30,626 INFO [Listener at localhost/37813] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-16 17:01:30,629 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:30,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:30,632 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:30,632 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-16 17:01:30,633 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:30,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:30,635 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:30,636 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c empty. 2023-02-16 17:01:30,637 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:30,637 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-16 17:01:30,664 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:30,666 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7a9e088cc70fade37cb613712037dd7c, NAME => 'testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp 2023-02-16 17:01:30,675 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:30,675 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 7a9e088cc70fade37cb613712037dd7c, disabling compactions & flushes 2023-02-16 17:01:30,675 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:30,675 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:30,675 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. after waiting 0 ms 2023-02-16 17:01:30,675 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:30,675 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:30,675 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 7a9e088cc70fade37cb613712037dd7c: 2023-02-16 17:01:30,678 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:30,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676566890678"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566890678"}]},"ts":"1676566890678"} 2023-02-16 17:01:30,680 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 17:01:30,681 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:30,681 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566890681"}]},"ts":"1676566890681"} 2023-02-16 17:01:30,682 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-16 17:01:30,688 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:30,690 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:30,690 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:30,690 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:30,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a9e088cc70fade37cb613712037dd7c, ASSIGN}] 2023-02-16 17:01:30,692 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a9e088cc70fade37cb613712037dd7c, ASSIGN 2023-02-16 17:01:30,693 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a9e088cc70fade37cb613712037dd7c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38773,1676566889491; forceNewPlan=false, retain=false 2023-02-16 17:01:30,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:30,785 INFO [RS:0;jenkins-hbase4:45407] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45407%2C1676566889461, suffix=, logDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/WALs/jenkins-hbase4.apache.org,45407,1676566889461, archiveDir=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/oldWALs, maxLogs=32 2023-02-16 17:01:30,801 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33183,DS-78a86b71-b3b5-4a65-b7ec-fbf76d4629fd,DISK] 2023-02-16 17:01:30,801 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45979,DS-3b1be21d-8b2e-498f-8aed-6a703e39b218,DISK] 2023-02-16 17:01:30,802 INFO [RS:0;jenkins-hbase4:45407] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/WALs/jenkins-hbase4.apache.org,45407,1676566889461/jenkins-hbase4.apache.org%2C45407%2C1676566889461.1676566890785 2023-02-16 17:01:30,803 DEBUG [RS:0;jenkins-hbase4:45407] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33183,DS-78a86b71-b3b5-4a65-b7ec-fbf76d4629fd,DISK], DatanodeInfoWithStorage[127.0.0.1:45979,DS-3b1be21d-8b2e-498f-8aed-6a703e39b218,DISK]] 2023-02-16 17:01:30,843 INFO [jenkins-hbase4:39537] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 17:01:30,844 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7a9e088cc70fade37cb613712037dd7c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:30,844 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676566890844"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566890844"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566890844"}]},"ts":"1676566890844"} 2023-02-16 17:01:30,846 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 7a9e088cc70fade37cb613712037dd7c, server=jenkins-hbase4.apache.org,38773,1676566889491}] 2023-02-16 17:01:30,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:31,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:31,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7a9e088cc70fade37cb613712037dd7c, NAME => 'testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:31,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:31,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:31,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:31,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:31,005 INFO [StoreOpener-7a9e088cc70fade37cb613712037dd7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:31,007 DEBUG [StoreOpener-7a9e088cc70fade37cb613712037dd7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1 2023-02-16 17:01:31,007 DEBUG [StoreOpener-7a9e088cc70fade37cb613712037dd7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1 2023-02-16 17:01:31,007 INFO [StoreOpener-7a9e088cc70fade37cb613712037dd7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a9e088cc70fade37cb613712037dd7c columnFamilyName f1 2023-02-16 17:01:31,008 INFO [StoreOpener-7a9e088cc70fade37cb613712037dd7c-1] regionserver.HStore(310): Store=7a9e088cc70fade37cb613712037dd7c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:31,008 INFO [StoreOpener-7a9e088cc70fade37cb613712037dd7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:31,009 DEBUG [StoreOpener-7a9e088cc70fade37cb613712037dd7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2 2023-02-16 17:01:31,009 DEBUG [StoreOpener-7a9e088cc70fade37cb613712037dd7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2 2023-02-16 17:01:31,010 INFO [StoreOpener-7a9e088cc70fade37cb613712037dd7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a9e088cc70fade37cb613712037dd7c columnFamilyName f2 2023-02-16 17:01:31,010 INFO [StoreOpener-7a9e088cc70fade37cb613712037dd7c-1] regionserver.HStore(310): Store=7a9e088cc70fade37cb613712037dd7c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:31,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:31,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:31,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:31,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:31,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:31,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7a9e088cc70fade37cb613712037dd7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67218018, jitterRate=0.001626521348953247}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:31,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7a9e088cc70fade37cb613712037dd7c: 2023-02-16 17:01:31,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c., pid=12, masterSystemTime=1676566890998 2023-02-16 17:01:31,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:31,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:31,026 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7a9e088cc70fade37cb613712037dd7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,026 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676566891026"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566891026"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566891026"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566891026"}]},"ts":"1676566891026"} 2023-02-16 17:01:31,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 17:01:31,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 7a9e088cc70fade37cb613712037dd7c, server=jenkins-hbase4.apache.org,38773,1676566889491 in 182 msec 2023-02-16 17:01:31,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 17:01:31,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a9e088cc70fade37cb613712037dd7c, ASSIGN in 339 msec 2023-02-16 17:01:31,032 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:31,032 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566891032"}]},"ts":"1676566891032"} 2023-02-16 17:01:31,034 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-16 17:01:31,037 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:31,038 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 408 msec 2023-02-16 17:01:31,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:31,241 INFO [Listener at localhost/37813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-16 17:01:31,241 DEBUG [Listener at localhost/37813] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-16 17:01:31,241 INFO [Listener at localhost/37813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:31,243 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-16 17:01:31,243 INFO [Listener at localhost/37813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:31,243 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-16 17:01:31,243 INFO [Listener at localhost/37813] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 17:01:31,288 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38773] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:31,412 INFO [Listener at localhost/37813] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 17:01:31,412 INFO [Listener at localhost/37813] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 17:01:31,414 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 17:01:31,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676566891414 (current time:1676566891414). 2023-02-16 17:01:31,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 17:01:31,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] zookeeper.ReadOnlyZKClient(139): Connect 0x2708f91d to 127.0.0.1:60229 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:31,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@467f737c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:31,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:31,423 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43926, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:31,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2708f91d to 127.0.0.1:60229 2023-02-16 17:01:31,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:31,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 17:01:31,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 17:01:31,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 17:01:31,428 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 17:01:31,429 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676567491429 2023-02-16 17:01:31,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-16 17:01:31,429 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,430 DEBUG [Listener at localhost/37813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:31,430 DEBUG [Listener at localhost/37813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 17:01:31,431 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-16 17:01:31,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 17:01:31,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-16 17:01:31,433 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 17:01:31,434 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676567491433 2023-02-16 17:01:31,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-16 17:01:31,449 INFO [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-16 17:01:31,449 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:31,450 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-16 17:01:31,450 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-16 17:01:31,451 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,451 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-16 17:01:31,453 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,453 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:31,453 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:31,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:31,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:31,453 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,453 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 17:01:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 17:01:31,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-16 17:01:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 17:01:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-16 17:01:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 17:01:31,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-16 17:01:31,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-16 17:01:31,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 17:01:31,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 17:01:31,455 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 17:01:31,455 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:31,455 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 17:01:31,456 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 17:01:31,456 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 17:01:31,456 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:31,456 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38773,1676566889491' joining acquired barrier for procedure (foo) in zk 2023-02-16 17:01:31,457 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 17:01:31,457 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 17:01:31,457 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45407,1676566889461' joining acquired barrier for procedure (foo) in zk 2023-02-16 17:01:31,458 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,458 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,458 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:31,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:31,458 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,459 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:31,458 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,459 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:31,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:31,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:31,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 17:01:31,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:31,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38773,1676566889491' joining acquired barrier for procedure 'foo' on coordinator 2023-02-16 17:01:31,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c3c047f[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:31,461 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-16 17:01:31,461 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,462 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,462 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,462 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 17:01:31,462 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,462 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:31,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,462 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 17:01:31,463 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 17:01:31,463 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,45407,1676566889461' in zk 2023-02-16 17:01:31,463 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 17:01:31,463 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 17:01:31,463 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:31,463 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. started... 2023-02-16 17:01:31,464 INFO [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7a9e088cc70fade37cb613712037dd7c 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 17:01:31,465 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 17:01:31,465 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:31,465 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 17:01:31,484 INFO [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/.tmp/f1/f0e83ae2026145609f31e431ef1392f5 2023-02-16 17:01:31,514 INFO [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/.tmp/f2/ca1ea12ffdd247bf81fa076066ea038d 2023-02-16 17:01:31,522 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/.tmp/f1/f0e83ae2026145609f31e431ef1392f5 as hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1/f0e83ae2026145609f31e431ef1392f5 2023-02-16 17:01:31,530 DEBUG [Listener at localhost/37813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:31,531 INFO [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1/f0e83ae2026145609f31e431ef1392f5, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 17:01:31,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-16 17:01:31,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:31,532 DEBUG [Listener at localhost/37813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 17:01:31,533 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/.tmp/f2/ca1ea12ffdd247bf81fa076066ea038d as hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2/ca1ea12ffdd247bf81fa076066ea038d 2023-02-16 17:01:31,538 INFO [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2/ca1ea12ffdd247bf81fa076066ea038d, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 17:01:31,539 INFO [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 7a9e088cc70fade37cb613712037dd7c in 75ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:31,539 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-16 17:01:31,540 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7a9e088cc70fade37cb613712037dd7c: 2023-02-16 17:01:31,540 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.' region-info for snapshot=foo 2023-02-16 17:01:31,540 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:31,540 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1/f0e83ae2026145609f31e431ef1392f5] hfiles 2023-02-16 17:01:31,540 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1/f0e83ae2026145609f31e431ef1392f5 for snapshot=foo 2023-02-16 17:01:31,540 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2/ca1ea12ffdd247bf81fa076066ea038d] hfiles 2023-02-16 17:01:31,540 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2/ca1ea12ffdd247bf81fa076066ea038d for snapshot=foo 2023-02-16 17:01:31,548 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. completed. 2023-02-16 17:01:31,548 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 17:01:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 17:01:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 17:01:31,548 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,38773,1676566889491' in zk 2023-02-16 17:01:31,550 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 17:01:31,550 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,550 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:31,550 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 17:01:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:31,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:31,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:31,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 17:01:31,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 17:01:31,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,38773,1676566889491': 2023-02-16 17:01:31,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38773,1676566889491' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-16 17:01:31,554 INFO [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-16 17:01:31,554 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:31,554 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:31,554 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-16 17:01:31,554 INFO [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 17:01:31,556 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,556 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:31,556 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,556 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:31,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,556 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:31,557 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:31,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 17:01:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,557 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 17:01:31,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,559 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:31,559 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 17:01:31,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,566 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,566 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:31,566 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 17:01:31,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:31,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:31,566 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:31,566 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:31,566 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-16 17:01:31,566 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:31,566 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-16 17:01:31,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:31,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:31,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:31,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:31,567 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:31,568 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 17:01:31,568 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,568 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,568 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,568 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 17:01:31,568 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 17:01:31,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.hbase-snapshot/.tmp/foo 2023-02-16 17:01:31,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:31,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:31,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.hbase-snapshot/.tmp/foo to hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.hbase-snapshot/foo 2023-02-16 17:01:31,600 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-16 17:01:31,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.hbase-snapshot/.tmp/foo 2023-02-16 17:01:31,600 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.hbase-snapshot/.tmp/foo 2023-02-16 17:01:31,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676566891429Consolidate snapshot: foo at 1676566891568 (+139 ms)Loading Region manifests for foo at 1676566891568Writing data manifest for foo at 1676566891571 (+3 ms)Verifying snapshot: foo at 1676566891579 (+8 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676566891600 (+21 ms) 2023-02-16 17:01:31,602 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-16 17:01:31,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 172 msec 2023-02-16 17:01:31,732 DEBUG [Listener at localhost/37813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:31,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-16 17:01:31,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 17:01:31,734 INFO [Listener at localhost/37813] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 17:01:31,739 INFO [Listener at localhost/37813] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 17:01:31,745 INFO [Listener at localhost/37813] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 17:01:31,783 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38773] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:31,889 INFO [Listener at localhost/37813] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 17:01:31,895 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 17:01:31,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,897 INFO [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-16 17:01:31,898 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:31,898 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-16 17:01:31,898 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-16 17:01:31,899 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,899 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,901 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,901 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:31,901 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:31,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:31,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:31,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:31,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:31,901 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,901 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:31,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,902 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,902 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,903 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-16 17:01:31,903 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:31,904 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-16 17:01:31,904 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-16 17:01:31,904 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45407,1676566889461' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-16 17:01:31,904 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-16 17:01:31,904 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:31,905 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-16 17:01:31,905 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 17:01:31,905 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 17:01:31,905 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:31,905 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. started... 2023-02-16 17:01:31,905 INFO [rs(jenkins-hbase4.apache.org,38773,1676566889491)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7a9e088cc70fade37cb613712037dd7c 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 17:01:31,907 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,907 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,907 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:31,924 INFO [rs(jenkins-hbase4.apache.org,38773,1676566889491)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/.tmp/f1/0fd38b3c40314057bcef2196d51a215a 2023-02-16 17:01:31,944 INFO [rs(jenkins-hbase4.apache.org,38773,1676566889491)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/.tmp/f2/9d50de41c08843cb9b352d1f0c3ee773 2023-02-16 17:01:31,948 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/.tmp/f1/0fd38b3c40314057bcef2196d51a215a as hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1/0fd38b3c40314057bcef2196d51a215a 2023-02-16 17:01:31,952 INFO [rs(jenkins-hbase4.apache.org,38773,1676566889491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1/0fd38b3c40314057bcef2196d51a215a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 17:01:31,953 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/.tmp/f2/9d50de41c08843cb9b352d1f0c3ee773 as hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2/9d50de41c08843cb9b352d1f0c3ee773 2023-02-16 17:01:31,957 INFO [rs(jenkins-hbase4.apache.org,38773,1676566889491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2/9d50de41c08843cb9b352d1f0c3ee773, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 17:01:31,958 INFO [rs(jenkins-hbase4.apache.org,38773,1676566889491)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 7a9e088cc70fade37cb613712037dd7c in 53ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:31,959 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7a9e088cc70fade37cb613712037dd7c: 2023-02-16 17:01:31,959 DEBUG [rs(jenkins-hbase4.apache.org,38773,1676566889491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:31,959 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 17:01:31,959 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 17:01:31,959 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,959 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-16 17:01:31,959 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38773,1676566889491' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-16 17:01:31,961 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,961 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:31,961 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,961 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:31,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38773,1676566889491' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-16 17:01:31,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78038f20[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:31,962 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-16 17:01:31,963 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,964 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,964 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,964 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-16 17:01:31,965 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-16 17:01:31,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,965 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,965 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:31,965 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,38773,1676566889491' in zk 2023-02-16 17:01:31,965 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-16 17:01:31,965 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-16 17:01:31,965 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,45407,1676566889461' in zk 2023-02-16 17:01:31,966 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-16 17:01:31,966 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,966 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:31,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:31,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:31,966 DEBUG [member: 'jenkins-hbase4.apache.org,38773,1676566889491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-16 17:01:31,967 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-16 17:01:31,967 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:31,967 DEBUG [member: 'jenkins-hbase4.apache.org,45407,1676566889461' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-16 17:01:31,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:31,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:31,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:31,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,38773,1676566889491': 2023-02-16 17:01:31,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38773,1676566889491' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-16 17:01:31,970 INFO [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-16 17:01:31,970 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:31,970 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:31,970 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,970 INFO [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 17:01:31,972 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,972 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,972 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:31,972 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:31,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:31,972 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:31,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,972 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:31,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:31,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:31,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:31,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:31,973 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:31,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,974 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:31,974 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,978 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,978 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:31,978 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:31,978 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,978 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:31,978 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:31,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:31,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:31,978 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:31,978 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:31,978 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:31,979 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,979 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:31,979 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,979 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:31,978 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-16 17:01:31,979 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 17:01:31,978 DEBUG [(jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:31,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:31,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:31,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:31,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:31,980 DEBUG [Listener at localhost/37813] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:31,980 DEBUG [Listener at localhost/37813] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 17:01:32,080 DEBUG [Listener at localhost/37813] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 17:01:32,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 17:01:32,087 INFO [Listener at localhost/37813] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676566891414 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:32,087 DEBUG [Listener at localhost/37813] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37829/user/jenkins/test-data/b6bf8466-0cbe-d877-3a3a-69bf11c5fcef/foo/a24d4a67-5b19-4dfe-9f90-c0b7dbafa679/data/default/testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,088 INFO [Listener at localhost/37813] snapshot.RestoreSnapshotHelper(239): region to add: 7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:32,088 INFO [Listener at localhost/37813] snapshot.RestoreSnapshotHelper(585): clone region=7a9e088cc70fade37cb613712037dd7c as 7a9e088cc70fade37cb613712037dd7c in snapshot foo 2023-02-16 17:01:32,089 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7a9e088cc70fade37cb613712037dd7c, NAME => 'testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37829/user/jenkins/test-data/b6bf8466-0cbe-d877-3a3a-69bf11c5fcef/foo/a24d4a67-5b19-4dfe-9f90-c0b7dbafa679 2023-02-16 17:01:32,100 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:32,100 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f0e83ae2026145609f31e431ef1392f5 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,102 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ca1ea12ffdd247bf81fa076066ea038d from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,104 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 7a9e088cc70fade37cb613712037dd7c, disabling compactions & flushes 2023-02-16 17:01:32,104 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:32,104 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:32,104 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. after waiting 0 ms 2023-02-16 17:01:32,104 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:32,105 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:32,105 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 7a9e088cc70fade37cb613712037dd7c: 2023-02-16 17:01:32,105 INFO [Listener at localhost/37813] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676566891414 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:32,105 DEBUG [Listener at localhost/37813] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37829/user/jenkins/test-data/b6bf8466-0cbe-d877-3a3a-69bf11c5fcef/foo/a24d4a67-5b19-4dfe-9f90-c0b7dbafa679 2023-02-16 17:01:32,105 DEBUG [Listener at localhost/37813] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37829/user/jenkins/test-data/b6bf8466-0cbe-d877-3a3a-69bf11c5fcef/foo/a24d4a67-5b19-4dfe-9f90-c0b7dbafa679 2023-02-16 17:01:32,105 DEBUG [Listener at localhost/37813] util.CommonFSUtils(699): |-data/ 2023-02-16 17:01:32,106 DEBUG [Listener at localhost/37813] util.CommonFSUtils(699): |----default/ 2023-02-16 17:01:32,107 DEBUG [Listener at localhost/37813] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-16 17:01:32,107 DEBUG [Listener at localhost/37813] util.CommonFSUtils(699): |----------7a9e088cc70fade37cb613712037dd7c/ 2023-02-16 17:01:32,108 DEBUG [Listener at localhost/37813] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:32,108 DEBUG [Listener at localhost/37813] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:32,108 DEBUG [Listener at localhost/37813] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=7a9e088cc70fade37cb613712037dd7c-f0e83ae2026145609f31e431ef1392f5 2023-02-16 17:01:32,108 DEBUG [Listener at localhost/37813] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:32,109 DEBUG [Listener at localhost/37813] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=7a9e088cc70fade37cb613712037dd7c-ca1ea12ffdd247bf81fa076066ea038d 2023-02-16 17:01:32,111 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-16 17:01:32,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-16 17:01:32,114 INFO [Listener at localhost/37813] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,115 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,118 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566892118"}]},"ts":"1676566892118"} 2023-02-16 17:01:32,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 17:01:32,119 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-16 17:01:32,121 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-16 17:01:32,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a9e088cc70fade37cb613712037dd7c, UNASSIGN}] 2023-02-16 17:01:32,124 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a9e088cc70fade37cb613712037dd7c, UNASSIGN 2023-02-16 17:01:32,124 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7a9e088cc70fade37cb613712037dd7c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:32,124 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676566892124"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566892124"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566892124"}]},"ts":"1676566892124"} 2023-02-16 17:01:32,126 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 7a9e088cc70fade37cb613712037dd7c, server=jenkins-hbase4.apache.org,38773,1676566889491}] 2023-02-16 17:01:32,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 17:01:32,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:32,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7a9e088cc70fade37cb613712037dd7c, disabling compactions & flushes 2023-02-16 17:01:32,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:32,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:32,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. after waiting 0 ms 2023-02-16 17:01:32,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:32,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:32,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c. 2023-02-16 17:01:32,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7a9e088cc70fade37cb613712037dd7c: 2023-02-16 17:01:32,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:32,284 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7a9e088cc70fade37cb613712037dd7c, regionState=CLOSED 2023-02-16 17:01:32,284 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676566892284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566892284"}]},"ts":"1676566892284"} 2023-02-16 17:01:32,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 17:01:32,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 7a9e088cc70fade37cb613712037dd7c, server=jenkins-hbase4.apache.org,38773,1676566889491 in 160 msec 2023-02-16 17:01:32,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 17:01:32,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=7a9e088cc70fade37cb613712037dd7c, UNASSIGN in 165 msec 2023-02-16 17:01:32,289 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566892289"}]},"ts":"1676566892289"} 2023-02-16 17:01:32,290 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-16 17:01:32,292 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-16 17:01:32,293 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 177 msec 2023-02-16 17:01:32,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 17:01:32,422 INFO [Listener at localhost/37813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-16 17:01:32,423 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,425 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,426 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 17:01:32,430 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:32,432 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1, FileablePath, hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2, FileablePath, hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/recovered.edits] 2023-02-16 17:01:32,436 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1/0fd38b3c40314057bcef2196d51a215a to hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/archive/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1/0fd38b3c40314057bcef2196d51a215a 2023-02-16 17:01:32,437 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1/f0e83ae2026145609f31e431ef1392f5 to hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/archive/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f1/f0e83ae2026145609f31e431ef1392f5 2023-02-16 17:01:32,440 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2/9d50de41c08843cb9b352d1f0c3ee773 to hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/archive/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2/9d50de41c08843cb9b352d1f0c3ee773 2023-02-16 17:01:32,441 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2/ca1ea12ffdd247bf81fa076066ea038d to hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/archive/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/f2/ca1ea12ffdd247bf81fa076066ea038d 2023-02-16 17:01:32,444 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/recovered.edits/12.seqid to hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/archive/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c/recovered.edits/12.seqid 2023-02-16 17:01:32,445 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/.tmp/data/default/testInitTableSnapshotMapperJobConfig/7a9e088cc70fade37cb613712037dd7c 2023-02-16 17:01:32,445 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-16 17:01:32,447 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,449 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-16 17:01:32,452 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-16 17:01:32,453 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,453 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-16 17:01:32,453 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566892453"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:32,455 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 17:01:32,455 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7a9e088cc70fade37cb613712037dd7c, NAME => 'testInitTableSnapshotMapperJobConfig,,1676566890629.7a9e088cc70fade37cb613712037dd7c.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 17:01:32,455 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-16 17:01:32,455 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676566892455"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:32,459 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-16 17:01:32,461 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-16 17:01:32,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 38 msec 2023-02-16 17:01:32,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39537] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 17:01:32,528 INFO [Listener at localhost/37813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-16 17:01:32,529 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 17:01:32,529 INFO [Listener at localhost/37813] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 17:01:32,529 DEBUG [Listener at localhost/37813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x368aba8b to 127.0.0.1:60229 2023-02-16 17:01:32,529 DEBUG [Listener at localhost/37813] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:32,529 DEBUG [Listener at localhost/37813] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 17:01:32,529 DEBUG [Listener at localhost/37813] util.JVMClusterUtil(257): Found active master hash=486814043, stopped=false 2023-02-16 17:01:32,529 INFO [Listener at localhost/37813] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39537,1676566889422 2023-02-16 17:01:32,532 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:32,533 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:32,533 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:32,533 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:32,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:32,535 INFO [Listener at localhost/37813] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 17:01:32,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:32,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:32,537 DEBUG [Listener at localhost/37813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75dd4e8c to 127.0.0.1:60229 2023-02-16 17:01:32,537 DEBUG [Listener at localhost/37813] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:32,537 INFO [Listener at localhost/37813] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45407,1676566889461' ***** 2023-02-16 17:01:32,537 INFO [Listener at localhost/37813] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:32,537 INFO [Listener at localhost/37813] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38773,1676566889491' ***** 2023-02-16 17:01:32,537 INFO [Listener at localhost/37813] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:32,537 INFO [RS:0;jenkins-hbase4:45407] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:32,537 INFO [RS:1;jenkins-hbase4:38773] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:32,537 INFO [RS:0;jenkins-hbase4:45407] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:32,537 INFO [RS:1;jenkins-hbase4:38773] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:32,537 INFO [RS:0;jenkins-hbase4:45407] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:32,537 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:32,538 INFO [RS:0;jenkins-hbase4:45407] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:32,537 INFO [RS:1;jenkins-hbase4:38773] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:32,539 DEBUG [RS:0;jenkins-hbase4:45407] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23fc6d6d to 127.0.0.1:60229 2023-02-16 17:01:32,539 INFO [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(3304): Received CLOSE for db0020a04787e12708bbbd7b68519764 2023-02-16 17:01:32,539 DEBUG [RS:0;jenkins-hbase4:45407] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:32,540 INFO [RS:0;jenkins-hbase4:45407] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45407,1676566889461; all regions closed. 2023-02-16 17:01:32,540 INFO [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:32,540 DEBUG [RS:1;jenkins-hbase4:38773] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c207ddf to 127.0.0.1:60229 2023-02-16 17:01:32,540 DEBUG [RS:1;jenkins-hbase4:38773] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:32,541 INFO [RS:1;jenkins-hbase4:38773] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:32,541 INFO [RS:1;jenkins-hbase4:38773] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:32,541 INFO [RS:1;jenkins-hbase4:38773] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:32,540 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:32,541 INFO [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 17:01:32,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing db0020a04787e12708bbbd7b68519764, disabling compactions & flushes 2023-02-16 17:01:32,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. 2023-02-16 17:01:32,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. 2023-02-16 17:01:32,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. after waiting 0 ms 2023-02-16 17:01:32,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. 2023-02-16 17:01:32,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing db0020a04787e12708bbbd7b68519764 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 17:01:32,543 INFO [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 17:01:32,543 DEBUG [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(1479): Online Regions={db0020a04787e12708bbbd7b68519764=hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764., 1588230740=hbase:meta,,1.1588230740} 2023-02-16 17:01:32,543 DEBUG [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(1505): Waiting on 1588230740, db0020a04787e12708bbbd7b68519764 2023-02-16 17:01:32,544 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:32,544 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:32,544 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:32,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:32,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:32,545 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-16 17:01:32,551 DEBUG [RS:0;jenkins-hbase4:45407] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/oldWALs 2023-02-16 17:01:32,551 INFO [RS:0;jenkins-hbase4:45407] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45407%2C1676566889461:(num 1676566890785) 2023-02-16 17:01:32,551 DEBUG [RS:0;jenkins-hbase4:45407] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:32,552 INFO [RS:0;jenkins-hbase4:45407] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:32,556 INFO [RS:0;jenkins-hbase4:45407] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:32,558 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:32,558 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:32,563 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:32,569 INFO [RS:0;jenkins-hbase4:45407] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:32,569 INFO [RS:0;jenkins-hbase4:45407] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:32,569 INFO [RS:0;jenkins-hbase4:45407] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:32,570 INFO [RS:0;jenkins-hbase4:45407] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45407 2023-02-16 17:01:32,572 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:32,572 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:32,573 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45407,1676566889461 2023-02-16 17:01:32,573 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:32,576 ERROR [Listener at localhost/37813-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@828dcc5 rejected from java.util.concurrent.ThreadPoolExecutor@c174918[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:32,576 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:32,576 ERROR [Listener at localhost/37813-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@369651d6 rejected from java.util.concurrent.ThreadPoolExecutor@c174918[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:32,576 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45407,1676566889461] 2023-02-16 17:01:32,577 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45407,1676566889461; numProcessing=1 2023-02-16 17:01:32,579 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45407,1676566889461 already deleted, retry=false 2023-02-16 17:01:32,579 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45407,1676566889461 expired; onlineServers=1 2023-02-16 17:01:32,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/namespace/db0020a04787e12708bbbd7b68519764/.tmp/info/924fa12dc816494597a0eb8d27614d90 2023-02-16 17:01:32,589 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/.tmp/info/e25bb939dde24afd836413db25bdeff4 2023-02-16 17:01:32,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/namespace/db0020a04787e12708bbbd7b68519764/.tmp/info/924fa12dc816494597a0eb8d27614d90 as hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/namespace/db0020a04787e12708bbbd7b68519764/info/924fa12dc816494597a0eb8d27614d90 2023-02-16 17:01:32,593 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e25bb939dde24afd836413db25bdeff4 2023-02-16 17:01:32,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/namespace/db0020a04787e12708bbbd7b68519764/info/924fa12dc816494597a0eb8d27614d90, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 17:01:32,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for db0020a04787e12708bbbd7b68519764 in 53ms, sequenceid=6, compaction requested=false 2023-02-16 17:01:32,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/namespace/db0020a04787e12708bbbd7b68519764/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 17:01:32,608 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. 2023-02-16 17:01:32,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for db0020a04787e12708bbbd7b68519764: 2023-02-16 17:01:32,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676566890115.db0020a04787e12708bbbd7b68519764. 2023-02-16 17:01:32,614 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/.tmp/rep_barrier/8ff2adb03ee7451e9253db6c8a4aec15 2023-02-16 17:01:32,618 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ff2adb03ee7451e9253db6c8a4aec15 2023-02-16 17:01:32,626 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/.tmp/table/b0a58192eee84394b9bb5c9592547797 2023-02-16 17:01:32,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0a58192eee84394b9bb5c9592547797 2023-02-16 17:01:32,630 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/.tmp/info/e25bb939dde24afd836413db25bdeff4 as hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/info/e25bb939dde24afd836413db25bdeff4 2023-02-16 17:01:32,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e25bb939dde24afd836413db25bdeff4 2023-02-16 17:01:32,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/info/e25bb939dde24afd836413db25bdeff4, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 17:01:32,636 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/.tmp/rep_barrier/8ff2adb03ee7451e9253db6c8a4aec15 as hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/rep_barrier/8ff2adb03ee7451e9253db6c8a4aec15 2023-02-16 17:01:32,641 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ff2adb03ee7451e9253db6c8a4aec15 2023-02-16 17:01:32,641 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/rep_barrier/8ff2adb03ee7451e9253db6c8a4aec15, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 17:01:32,642 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/.tmp/table/b0a58192eee84394b9bb5c9592547797 as hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/table/b0a58192eee84394b9bb5c9592547797 2023-02-16 17:01:32,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0a58192eee84394b9bb5c9592547797 2023-02-16 17:01:32,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/table/b0a58192eee84394b9bb5c9592547797, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 17:01:32,647 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 102ms, sequenceid=21, compaction requested=false 2023-02-16 17:01:32,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 17:01:32,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 17:01:32,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:32,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:32,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:32,733 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:32,733 INFO [RS:0;jenkins-hbase4:45407] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45407,1676566889461; zookeeper connection closed. 2023-02-16 17:01:32,733 ERROR [Listener at localhost/37813-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4effa4b6 rejected from java.util.concurrent.ThreadPoolExecutor@c174918[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:32,733 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:45407-0x1005e146d820001, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:32,733 ERROR [Listener at localhost/37813-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2d26d5a1 rejected from java.util.concurrent.ThreadPoolExecutor@c174918[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:32,733 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2ac229f4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2ac229f4 2023-02-16 17:01:32,743 INFO [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38773,1676566889491; all regions closed. 2023-02-16 17:01:32,747 DEBUG [RS:1;jenkins-hbase4:38773] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/oldWALs 2023-02-16 17:01:32,748 INFO [RS:1;jenkins-hbase4:38773] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38773%2C1676566889491.meta:.meta(num 1676566890028) 2023-02-16 17:01:32,752 DEBUG [RS:1;jenkins-hbase4:38773] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/oldWALs 2023-02-16 17:01:32,752 INFO [RS:1;jenkins-hbase4:38773] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38773%2C1676566889491:(num 1676566890461) 2023-02-16 17:01:32,752 DEBUG [RS:1;jenkins-hbase4:38773] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:32,752 INFO [RS:1;jenkins-hbase4:38773] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:32,752 INFO [RS:1;jenkins-hbase4:38773] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:32,752 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:32,753 INFO [RS:1;jenkins-hbase4:38773] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38773 2023-02-16 17:01:32,756 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38773,1676566889491 2023-02-16 17:01:32,756 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:32,756 ERROR [Listener at localhost/37813-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56059172 rejected from java.util.concurrent.ThreadPoolExecutor@523a1f6a[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:32,757 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38773,1676566889491] 2023-02-16 17:01:32,757 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38773,1676566889491; numProcessing=2 2023-02-16 17:01:32,758 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38773,1676566889491 already deleted, retry=false 2023-02-16 17:01:32,758 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38773,1676566889491 expired; onlineServers=0 2023-02-16 17:01:32,759 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39537,1676566889422' ***** 2023-02-16 17:01:32,759 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 17:01:32,759 DEBUG [M:0;jenkins-hbase4:39537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@193ba623, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:32,759 INFO [M:0;jenkins-hbase4:39537] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39537,1676566889422 2023-02-16 17:01:32,759 INFO [M:0;jenkins-hbase4:39537] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39537,1676566889422; all regions closed. 2023-02-16 17:01:32,759 DEBUG [M:0;jenkins-hbase4:39537] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:32,759 DEBUG [M:0;jenkins-hbase4:39537] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 17:01:32,759 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 17:01:32,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566889651] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566889651,5,FailOnTimeoutGroup] 2023-02-16 17:01:32,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566889651] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566889651,5,FailOnTimeoutGroup] 2023-02-16 17:01:32,759 DEBUG [M:0;jenkins-hbase4:39537] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 17:01:32,761 INFO [M:0;jenkins-hbase4:39537] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 17:01:32,761 INFO [M:0;jenkins-hbase4:39537] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 17:01:32,761 INFO [M:0;jenkins-hbase4:39537] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 17:01:32,761 DEBUG [M:0;jenkins-hbase4:39537] master.HMaster(1512): Stopping service threads 2023-02-16 17:01:32,761 INFO [M:0;jenkins-hbase4:39537] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 17:01:32,761 ERROR [M:0;jenkins-hbase4:39537] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 17:01:32,762 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:32,762 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:32,762 INFO [M:0;jenkins-hbase4:39537] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 17:01:32,762 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 17:01:32,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:32,762 DEBUG [M:0;jenkins-hbase4:39537] zookeeper.ZKUtil(398): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 17:01:32,762 WARN [M:0;jenkins-hbase4:39537] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 17:01:32,762 INFO [M:0;jenkins-hbase4:39537] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 17:01:32,763 INFO [M:0;jenkins-hbase4:39537] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 17:01:32,763 DEBUG [M:0;jenkins-hbase4:39537] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:32,763 INFO [M:0;jenkins-hbase4:39537] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:32,763 DEBUG [M:0;jenkins-hbase4:39537] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:32,763 DEBUG [M:0;jenkins-hbase4:39537] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:32,763 DEBUG [M:0;jenkins-hbase4:39537] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:32,763 INFO [M:0;jenkins-hbase4:39537] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.87 KB heapSize=66.80 KB 2023-02-16 17:01:32,772 INFO [M:0;jenkins-hbase4:39537] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.87 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/16768b7317fc44069c0c723908d42cd7 2023-02-16 17:01:32,776 DEBUG [M:0;jenkins-hbase4:39537] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/16768b7317fc44069c0c723908d42cd7 as hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/16768b7317fc44069c0c723908d42cd7 2023-02-16 17:01:32,781 INFO [M:0;jenkins-hbase4:39537] regionserver.HStore(1080): Added hdfs://localhost:37829/user/jenkins/test-data/18785401-ab52-d73b-1aac-21f95df6fcec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/16768b7317fc44069c0c723908d42cd7, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 17:01:32,782 INFO [M:0;jenkins-hbase4:39537] regionserver.HRegion(2947): Finished flush of dataSize ~55.87 KB/57209, heapSize ~66.79 KB/68392, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-16 17:01:32,782 INFO [M:0;jenkins-hbase4:39537] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:32,782 DEBUG [M:0;jenkins-hbase4:39537] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:32,787 INFO [M:0;jenkins-hbase4:39537] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 17:01:32,787 INFO [M:0;jenkins-hbase4:39537] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39537 2023-02-16 17:01:32,787 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:32,790 DEBUG [M:0;jenkins-hbase4:39537] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39537,1676566889422 already deleted, retry=false 2023-02-16 17:01:33,133 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:33,133 INFO [M:0;jenkins-hbase4:39537] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39537,1676566889422; zookeeper connection closed. 2023-02-16 17:01:33,133 ERROR [Listener at localhost/37813-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@33355470 rejected from java.util.concurrent.ThreadPoolExecutor@370ac6ce[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:33,134 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): master:39537-0x1005e146d820000, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:33,134 ERROR [Listener at localhost/37813-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a3f82e9 rejected from java.util.concurrent.ThreadPoolExecutor@370ac6ce[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:33,233 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:33,233 INFO [RS:1;jenkins-hbase4:38773] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38773,1676566889491; zookeeper connection closed. 2023-02-16 17:01:33,233 ERROR [Listener at localhost/37813-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c915f10 rejected from java.util.concurrent.ThreadPoolExecutor@523a1f6a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:33,234 DEBUG [Listener at localhost/37813-EventThread] zookeeper.ZKWatcher(600): regionserver:38773-0x1005e146d820002, quorum=127.0.0.1:60229, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:33,234 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6cfd8f59] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6cfd8f59 2023-02-16 17:01:33,234 ERROR [Listener at localhost/37813-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@24265118 rejected from java.util.concurrent.ThreadPoolExecutor@523a1f6a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:33,234 INFO [Listener at localhost/37813] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 17:01:33,234 WARN [Listener at localhost/37813] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:33,238 INFO [Listener at localhost/37813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:33,343 WARN [BP-1401927356-172.31.14.131-1676566888803 heartbeating to localhost/127.0.0.1:37829] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 17:01:33,343 WARN [BP-1401927356-172.31.14.131-1676566888803 heartbeating to localhost/127.0.0.1:37829] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1401927356-172.31.14.131-1676566888803 (Datanode Uuid f77fd786-831d-4f5a-864d-c11bebc1c482) service to localhost/127.0.0.1:37829 2023-02-16 17:01:33,346 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/cluster_86b1b406-89ba-7da5-146e-5fa4642be4a3/dfs/data/data3/current/BP-1401927356-172.31.14.131-1676566888803] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:33,346 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/cluster_86b1b406-89ba-7da5-146e-5fa4642be4a3/dfs/data/data4/current/BP-1401927356-172.31.14.131-1676566888803] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:33,348 WARN [Listener at localhost/37813] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:33,353 INFO [Listener at localhost/37813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:33,457 WARN [BP-1401927356-172.31.14.131-1676566888803 heartbeating to localhost/127.0.0.1:37829] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 17:01:33,457 WARN [BP-1401927356-172.31.14.131-1676566888803 heartbeating to localhost/127.0.0.1:37829] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1401927356-172.31.14.131-1676566888803 (Datanode Uuid c4e222a2-2408-43ef-9118-b3f85bb80de9) service to localhost/127.0.0.1:37829 2023-02-16 17:01:33,458 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/cluster_86b1b406-89ba-7da5-146e-5fa4642be4a3/dfs/data/data1/current/BP-1401927356-172.31.14.131-1676566888803] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:33,458 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/cluster_86b1b406-89ba-7da5-146e-5fa4642be4a3/dfs/data/data2/current/BP-1401927356-172.31.14.131-1676566888803] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:33,470 INFO [Listener at localhost/37813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:33,585 INFO [Listener at localhost/37813] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 17:01:33,611 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 17:01:33,628 INFO [Listener at localhost/37813] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=178 (was 156) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:37829 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:37829 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37813 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39537,1676566889422)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:37829 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:37829 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:37829 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:37829 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37829 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=572 (was 536) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=339 (was 325) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1270 (was 1515) 2023-02-16 17:01:33,640 INFO [Listener at localhost/37813] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=178, OpenFileDescriptor=572, MaxFileDescriptor=60000, SystemLoadAverage=339, ProcessCount=169, AvailableMemoryMB=1270 2023-02-16 17:01:33,651 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/hadoop.log.dir so I do NOT create it in target/test-data/2902c152-5b88-2863-83e1-ce879567963e 2023-02-16 17:01:33,651 WARN [Listener at localhost/37813] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 17:01:33,651 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/hadoop.tmp.dir so I do NOT create it in target/test-data/2902c152-5b88-2863-83e1-ce879567963e 2023-02-16 17:01:33,651 WARN [Listener at localhost/37813] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10747ca4-6489-356b-81a3-2fedff9a2d7d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 17:01:33,651 DEBUG [Listener at localhost/37813] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e 2023-02-16 17:01:33,651 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 17:01:33,651 INFO [Listener at localhost/37813] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/cluster_bd2238dd-2102-d5e3-20bf-8c0574d66ce8, deleteOnExit=true 2023-02-16 17:01:33,651 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 17:01:33,651 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/test.cache.data in system properties and HBase conf 2023-02-16 17:01:33,651 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 17:01:33,652 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/hadoop.log.dir in system properties and HBase conf 2023-02-16 17:01:33,652 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 17:01:33,652 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 17:01:33,652 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 17:01:33,652 DEBUG [Listener at localhost/37813] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 17:01:33,652 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:01:33,652 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:01:33,652 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 17:01:33,652 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:01:33,652 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 17:01:33,653 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 17:01:33,653 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:01:33,653 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:01:33,653 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 17:01:33,653 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/nfs.dump.dir in system properties and HBase conf 2023-02-16 17:01:33,653 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/java.io.tmpdir in system properties and HBase conf 2023-02-16 17:01:33,653 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:01:33,653 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 17:01:33,653 INFO [Listener at localhost/37813] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 17:01:33,658 WARN [Listener at localhost/37813] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:01:33,658 WARN [Listener at localhost/37813] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:01:33,701 WARN [Listener at localhost/37813] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:33,704 INFO [Listener at localhost/37813] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:33,711 INFO [Listener at localhost/37813] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/java.io.tmpdir/Jetty_localhost_42195_hdfs____.hjis1z/webapp 2023-02-16 17:01:33,803 INFO [Listener at localhost/37813] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42195 2023-02-16 17:01:33,807 WARN [Listener at localhost/37813] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:01:33,807 WARN [Listener at localhost/37813] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:01:33,845 WARN [Listener at localhost/40231] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:33,854 WARN [Listener at localhost/40231] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:33,856 WARN [Listener at localhost/40231] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:33,857 INFO [Listener at localhost/40231] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:33,864 INFO [Listener at localhost/40231] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/java.io.tmpdir/Jetty_localhost_39709_datanode____.pep873/webapp 2023-02-16 17:01:33,956 INFO [Listener at localhost/40231] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39709 2023-02-16 17:01:33,963 WARN [Listener at localhost/43121] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:33,977 WARN [Listener at localhost/43121] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:33,979 WARN [Listener at localhost/43121] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:33,980 INFO [Listener at localhost/43121] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:33,984 INFO [Listener at localhost/43121] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/java.io.tmpdir/Jetty_localhost_39643_datanode____gcz4hi/webapp 2023-02-16 17:01:34,080 INFO [Listener at localhost/43121] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39643 2023-02-16 17:01:34,087 WARN [Listener at localhost/35457] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:34,103 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8af5cc23159cdbd7: Processing first storage report for DS-cc38f951-7a6a-4806-8a2b-7c7a7c7dace0 from datanode f9ff6654-be8d-44cb-a9a4-61d6b67d366f 2023-02-16 17:01:34,103 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8af5cc23159cdbd7: from storage DS-cc38f951-7a6a-4806-8a2b-7c7a7c7dace0 node DatanodeRegistration(127.0.0.1:34967, datanodeUuid=f9ff6654-be8d-44cb-a9a4-61d6b67d366f, infoPort=41449, infoSecurePort=0, ipcPort=43121, storageInfo=lv=-57;cid=testClusterID;nsid=29921736;c=1676566893660), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:34,104 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8af5cc23159cdbd7: Processing first storage report for DS-de3dcca6-5fcc-4188-b0a8-9b242255cd79 from datanode f9ff6654-be8d-44cb-a9a4-61d6b67d366f 2023-02-16 17:01:34,104 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8af5cc23159cdbd7: from storage DS-de3dcca6-5fcc-4188-b0a8-9b242255cd79 node DatanodeRegistration(127.0.0.1:34967, datanodeUuid=f9ff6654-be8d-44cb-a9a4-61d6b67d366f, infoPort=41449, infoSecurePort=0, ipcPort=43121, storageInfo=lv=-57;cid=testClusterID;nsid=29921736;c=1676566893660), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:34,191 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4d969082566c2616: Processing first storage report for DS-488e02d0-83a6-4330-bbd1-00bdae84c086 from datanode 92175bd5-fab4-413e-8018-c06ed2b9dcb5 2023-02-16 17:01:34,191 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4d969082566c2616: from storage DS-488e02d0-83a6-4330-bbd1-00bdae84c086 node DatanodeRegistration(127.0.0.1:39293, datanodeUuid=92175bd5-fab4-413e-8018-c06ed2b9dcb5, infoPort=43035, infoSecurePort=0, ipcPort=35457, storageInfo=lv=-57;cid=testClusterID;nsid=29921736;c=1676566893660), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:34,191 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4d969082566c2616: Processing first storage report for DS-f4a14387-833d-4bf0-bf1e-963f085e9d7b from datanode 92175bd5-fab4-413e-8018-c06ed2b9dcb5 2023-02-16 17:01:34,191 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4d969082566c2616: from storage DS-f4a14387-833d-4bf0-bf1e-963f085e9d7b node DatanodeRegistration(127.0.0.1:39293, datanodeUuid=92175bd5-fab4-413e-8018-c06ed2b9dcb5, infoPort=43035, infoSecurePort=0, ipcPort=35457, storageInfo=lv=-57;cid=testClusterID;nsid=29921736;c=1676566893660), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:34,204 DEBUG [Listener at localhost/35457] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e 2023-02-16 17:01:34,207 INFO [Listener at localhost/35457] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/cluster_bd2238dd-2102-d5e3-20bf-8c0574d66ce8/zookeeper_0, clientPort=58835, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/cluster_bd2238dd-2102-d5e3-20bf-8c0574d66ce8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/cluster_bd2238dd-2102-d5e3-20bf-8c0574d66ce8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 17:01:34,208 INFO [Listener at localhost/35457] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58835 2023-02-16 17:01:34,208 INFO [Listener at localhost/35457] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:34,209 INFO [Listener at localhost/35457] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:34,222 INFO [Listener at localhost/35457] util.FSUtils(479): Created version file at hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e with version=8 2023-02-16 17:01:34,222 INFO [Listener at localhost/35457] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:34,223 INFO [Listener at localhost/35457] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:34,224 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/hbase-staging 2023-02-16 17:01:34,226 INFO [Listener at localhost/35457] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:34,226 INFO [Listener at localhost/35457] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:34,226 INFO [Listener at localhost/35457] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:34,226 INFO [Listener at localhost/35457] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:34,226 INFO [Listener at localhost/35457] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:34,226 INFO [Listener at localhost/35457] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:34,226 INFO [Listener at localhost/35457] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:34,227 INFO [Listener at localhost/35457] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40979 2023-02-16 17:01:34,227 INFO [Listener at localhost/35457] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:34,228 INFO [Listener at localhost/35457] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:34,229 INFO [Listener at localhost/35457] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40979 connecting to ZooKeeper ensemble=127.0.0.1:58835 2023-02-16 17:01:34,236 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:409790x0, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:34,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40979-0x1005e1480420000 connected 2023-02-16 17:01:34,250 DEBUG [Listener at localhost/35457] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:34,250 DEBUG [Listener at localhost/35457] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:34,251 DEBUG [Listener at localhost/35457] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:34,251 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40979 2023-02-16 17:01:34,251 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40979 2023-02-16 17:01:34,252 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40979 2023-02-16 17:01:34,252 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40979 2023-02-16 17:01:34,252 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40979 2023-02-16 17:01:34,252 INFO [Listener at localhost/35457] master.HMaster(444): hbase.rootdir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e, hbase.cluster.distributed=false 2023-02-16 17:01:34,265 INFO [Listener at localhost/35457] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:34,265 INFO [Listener at localhost/35457] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:34,265 INFO [Listener at localhost/35457] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:34,265 INFO [Listener at localhost/35457] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:34,265 INFO [Listener at localhost/35457] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:34,265 INFO [Listener at localhost/35457] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:34,265 INFO [Listener at localhost/35457] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:34,266 INFO [Listener at localhost/35457] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46079 2023-02-16 17:01:34,266 INFO [Listener at localhost/35457] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:34,268 DEBUG [Listener at localhost/35457] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:34,268 INFO [Listener at localhost/35457] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:34,269 INFO [Listener at localhost/35457] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:34,270 INFO [Listener at localhost/35457] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46079 connecting to ZooKeeper ensemble=127.0.0.1:58835 2023-02-16 17:01:34,273 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:460790x0, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:34,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46079-0x1005e1480420001 connected 2023-02-16 17:01:34,274 DEBUG [Listener at localhost/35457] zookeeper.ZKUtil(164): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:34,275 DEBUG [Listener at localhost/35457] zookeeper.ZKUtil(164): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:34,275 DEBUG [Listener at localhost/35457] zookeeper.ZKUtil(164): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:34,276 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46079 2023-02-16 17:01:34,276 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46079 2023-02-16 17:01:34,276 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46079 2023-02-16 17:01:34,277 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46079 2023-02-16 17:01:34,277 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46079 2023-02-16 17:01:34,287 INFO [Listener at localhost/35457] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:34,287 INFO [Listener at localhost/35457] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:34,288 INFO [Listener at localhost/35457] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:34,288 INFO [Listener at localhost/35457] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:34,288 INFO [Listener at localhost/35457] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:34,288 INFO [Listener at localhost/35457] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:34,288 INFO [Listener at localhost/35457] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:34,288 INFO [Listener at localhost/35457] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37679 2023-02-16 17:01:34,289 INFO [Listener at localhost/35457] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:34,290 DEBUG [Listener at localhost/35457] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:34,290 INFO [Listener at localhost/35457] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:34,291 INFO [Listener at localhost/35457] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:34,292 INFO [Listener at localhost/35457] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37679 connecting to ZooKeeper ensemble=127.0.0.1:58835 2023-02-16 17:01:34,294 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:376790x0, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:34,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37679-0x1005e1480420002 connected 2023-02-16 17:01:34,296 DEBUG [Listener at localhost/35457] zookeeper.ZKUtil(164): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:34,296 DEBUG [Listener at localhost/35457] zookeeper.ZKUtil(164): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:34,297 DEBUG [Listener at localhost/35457] zookeeper.ZKUtil(164): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:34,298 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37679 2023-02-16 17:01:34,298 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37679 2023-02-16 17:01:34,299 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37679 2023-02-16 17:01:34,299 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37679 2023-02-16 17:01:34,299 DEBUG [Listener at localhost/35457] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37679 2023-02-16 17:01:34,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40979,1676566894225 2023-02-16 17:01:34,302 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:34,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40979,1676566894225 2023-02-16 17:01:34,304 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:34,304 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:34,304 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:34,304 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:34,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:34,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40979,1676566894225 from backup master directory 2023-02-16 17:01:34,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:34,307 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40979,1676566894225 2023-02-16 17:01:34,307 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:34,308 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:34,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40979,1676566894225 2023-02-16 17:01:34,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/hbase.id with ID: e97f14cf-6cc8-4aa9-994e-14045d4ef5d2 2023-02-16 17:01:34,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:34,328 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:34,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5b596249 to 127.0.0.1:58835 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:34,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@100dd09f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:34,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:34,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 17:01:34,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:34,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/data/master/store-tmp 2023-02-16 17:01:34,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:34,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:34,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:34,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:34,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:34,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:34,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:34,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:34,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/WALs/jenkins-hbase4.apache.org,40979,1676566894225 2023-02-16 17:01:34,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40979%2C1676566894225, suffix=, logDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/WALs/jenkins-hbase4.apache.org,40979,1676566894225, archiveDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/oldWALs, maxLogs=10 2023-02-16 17:01:34,371 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39293,DS-488e02d0-83a6-4330-bbd1-00bdae84c086,DISK] 2023-02-16 17:01:34,371 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34967,DS-cc38f951-7a6a-4806-8a2b-7c7a7c7dace0,DISK] 2023-02-16 17:01:34,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/WALs/jenkins-hbase4.apache.org,40979,1676566894225/jenkins-hbase4.apache.org%2C40979%2C1676566894225.1676566894351 2023-02-16 17:01:34,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34967,DS-cc38f951-7a6a-4806-8a2b-7c7a7c7dace0,DISK], DatanodeInfoWithStorage[127.0.0.1:39293,DS-488e02d0-83a6-4330-bbd1-00bdae84c086,DISK]] 2023-02-16 17:01:34,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:34,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:34,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:34,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:34,376 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:34,377 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 17:01:34,378 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 17:01:34,378 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:34,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:34,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:34,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:34,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:34,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73344162, jitterRate=0.0929131805896759}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:34,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:34,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 17:01:34,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 17:01:34,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 17:01:34,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 17:01:34,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 17:01:34,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 17:01:34,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 17:01:34,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 17:01:34,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 17:01:34,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 17:01:34,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 17:01:34,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 17:01:34,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 17:01:34,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 17:01:34,401 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:34,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 17:01:34,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 17:01:34,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 17:01:34,403 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:34,404 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:34,404 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:34,404 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:34,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40979,1676566894225, sessionid=0x1005e1480420000, setting cluster-up flag (Was=false) 2023-02-16 17:01:34,410 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:34,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 17:01:34,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40979,1676566894225 2023-02-16 17:01:34,418 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:34,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 17:01:34,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40979,1676566894225 2023-02-16 17:01:34,424 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.hbase-snapshot/.tmp 2023-02-16 17:01:34,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:34,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:34,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:34,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:34,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:34,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 17:01:34,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:34,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676566924430 2023-02-16 17:01:34,430 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:34,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 17:01:34,430 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 17:01:34,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 17:01:34,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 17:01:34,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 17:01:34,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 17:01:34,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 17:01:34,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 17:01:34,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 17:01:34,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 17:01:34,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 17:01:34,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 17:01:34,432 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:34,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566894432,5,FailOnTimeoutGroup] 2023-02-16 17:01:34,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566894436,5,FailOnTimeoutGroup] 2023-02-16 17:01:34,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 17:01:34,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,447 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:34,448 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:34,448 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e 2023-02-16 17:01:34,462 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:34,463 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:34,464 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/info 2023-02-16 17:01:34,465 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:34,465 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:34,465 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:34,466 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:34,467 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:34,467 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:34,467 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:34,468 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/table 2023-02-16 17:01:34,469 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:34,469 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:34,470 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740 2023-02-16 17:01:34,470 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740 2023-02-16 17:01:34,472 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:34,473 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:34,475 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:34,475 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75367930, jitterRate=0.12306967377662659}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:34,475 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:34,475 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:34,475 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:34,475 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:34,475 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:34,475 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:34,476 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:34,476 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:34,476 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:34,476 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 17:01:34,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 17:01:34,478 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 17:01:34,480 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 17:01:34,501 INFO [RS:1;jenkins-hbase4:37679] regionserver.HRegionServer(952): ClusterId : e97f14cf-6cc8-4aa9-994e-14045d4ef5d2 2023-02-16 17:01:34,501 INFO [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(952): ClusterId : e97f14cf-6cc8-4aa9-994e-14045d4ef5d2 2023-02-16 17:01:34,501 DEBUG [RS:1;jenkins-hbase4:37679] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:34,501 DEBUG [RS:0;jenkins-hbase4:46079] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:34,503 DEBUG [RS:0;jenkins-hbase4:46079] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:34,503 DEBUG [RS:1;jenkins-hbase4:37679] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:34,503 DEBUG [RS:0;jenkins-hbase4:46079] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:34,503 DEBUG [RS:1;jenkins-hbase4:37679] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:34,505 DEBUG [RS:0;jenkins-hbase4:46079] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:34,507 DEBUG [RS:0;jenkins-hbase4:46079] zookeeper.ReadOnlyZKClient(139): Connect 0x2d1adf27 to 127.0.0.1:58835 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:34,507 DEBUG [RS:1;jenkins-hbase4:37679] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:34,508 DEBUG [RS:1;jenkins-hbase4:37679] zookeeper.ReadOnlyZKClient(139): Connect 0x6532970c to 127.0.0.1:58835 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:34,517 DEBUG [RS:0;jenkins-hbase4:46079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23dd24f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:34,517 DEBUG [RS:1;jenkins-hbase4:37679] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bf565da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:34,517 DEBUG [RS:0;jenkins-hbase4:46079] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27e2b457, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:34,517 DEBUG [RS:1;jenkins-hbase4:37679] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fcafc7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:34,531 DEBUG [RS:0;jenkins-hbase4:46079] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46079 2023-02-16 17:01:34,531 DEBUG [RS:1;jenkins-hbase4:37679] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37679 2023-02-16 17:01:34,531 INFO [RS:0;jenkins-hbase4:46079] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:34,531 INFO [RS:0;jenkins-hbase4:46079] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:34,531 INFO [RS:1;jenkins-hbase4:37679] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:34,531 INFO [RS:1;jenkins-hbase4:37679] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:34,531 DEBUG [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:34,531 DEBUG [RS:1;jenkins-hbase4:37679] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:34,532 INFO [RS:1;jenkins-hbase4:37679] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40979,1676566894225 with isa=jenkins-hbase4.apache.org/172.31.14.131:37679, startcode=1676566894287 2023-02-16 17:01:34,532 INFO [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40979,1676566894225 with isa=jenkins-hbase4.apache.org/172.31.14.131:46079, startcode=1676566894264 2023-02-16 17:01:34,532 DEBUG [RS:1;jenkins-hbase4:37679] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:34,532 DEBUG [RS:0;jenkins-hbase4:46079] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:34,537 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53337, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:34,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:34,542 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36549, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:34,542 DEBUG [RS:1;jenkins-hbase4:37679] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e 2023-02-16 17:01:34,542 DEBUG [RS:1;jenkins-hbase4:37679] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40231 2023-02-16 17:01:34,542 DEBUG [RS:1;jenkins-hbase4:37679] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:34,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:34,543 DEBUG [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e 2023-02-16 17:01:34,543 DEBUG [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40231 2023-02-16 17:01:34,543 DEBUG [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:34,544 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:34,548 DEBUG [RS:1;jenkins-hbase4:37679] zookeeper.ZKUtil(162): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:34,548 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46079,1676566894264] 2023-02-16 17:01:34,548 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37679,1676566894287] 2023-02-16 17:01:34,548 WARN [RS:1;jenkins-hbase4:37679] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:34,548 DEBUG [RS:0;jenkins-hbase4:46079] zookeeper.ZKUtil(162): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:34,548 INFO [RS:1;jenkins-hbase4:37679] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:34,548 WARN [RS:0;jenkins-hbase4:46079] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:34,548 INFO [RS:0;jenkins-hbase4:46079] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:34,548 DEBUG [RS:1;jenkins-hbase4:37679] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/WALs/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:34,548 DEBUG [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/WALs/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:34,565 DEBUG [RS:1;jenkins-hbase4:37679] zookeeper.ZKUtil(162): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:34,567 DEBUG [RS:0;jenkins-hbase4:46079] zookeeper.ZKUtil(162): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:34,568 DEBUG [RS:1;jenkins-hbase4:37679] zookeeper.ZKUtil(162): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:34,568 DEBUG [RS:0;jenkins-hbase4:46079] zookeeper.ZKUtil(162): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:34,568 DEBUG [RS:1;jenkins-hbase4:37679] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:34,569 INFO [RS:1;jenkins-hbase4:37679] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:34,569 DEBUG [RS:0;jenkins-hbase4:46079] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:34,570 INFO [RS:0;jenkins-hbase4:46079] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:34,570 INFO [RS:1;jenkins-hbase4:37679] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:34,571 INFO [RS:1;jenkins-hbase4:37679] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:34,571 INFO [RS:0;jenkins-hbase4:46079] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:34,571 INFO [RS:1;jenkins-hbase4:37679] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,571 INFO [RS:0;jenkins-hbase4:46079] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:34,571 INFO [RS:1;jenkins-hbase4:37679] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:34,571 INFO [RS:0;jenkins-hbase4:46079] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,572 INFO [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:34,573 INFO [RS:1;jenkins-hbase4:37679] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,574 DEBUG [RS:1;jenkins-hbase4:37679] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,574 INFO [RS:0;jenkins-hbase4:46079] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,574 DEBUG [RS:1;jenkins-hbase4:37679] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,574 DEBUG [RS:1;jenkins-hbase4:37679] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,574 DEBUG [RS:0;jenkins-hbase4:46079] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,574 DEBUG [RS:1;jenkins-hbase4:37679] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,574 DEBUG [RS:0;jenkins-hbase4:46079] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,574 DEBUG [RS:1;jenkins-hbase4:37679] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,574 DEBUG [RS:0;jenkins-hbase4:46079] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,574 DEBUG [RS:1;jenkins-hbase4:37679] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:34,574 DEBUG [RS:0;jenkins-hbase4:46079] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,574 DEBUG [RS:1;jenkins-hbase4:37679] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,574 DEBUG [RS:0;jenkins-hbase4:46079] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,574 DEBUG [RS:1;jenkins-hbase4:37679] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,574 DEBUG [RS:0;jenkins-hbase4:46079] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:34,574 DEBUG [RS:1;jenkins-hbase4:37679] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,575 DEBUG [RS:0;jenkins-hbase4:46079] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,575 DEBUG [RS:1;jenkins-hbase4:37679] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,575 DEBUG [RS:0;jenkins-hbase4:46079] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,575 DEBUG [RS:0;jenkins-hbase4:46079] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,575 DEBUG [RS:0;jenkins-hbase4:46079] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:34,580 INFO [RS:0;jenkins-hbase4:46079] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,580 INFO [RS:0;jenkins-hbase4:46079] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,581 INFO [RS:0;jenkins-hbase4:46079] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,589 INFO [RS:1;jenkins-hbase4:37679] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,590 INFO [RS:1;jenkins-hbase4:37679] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,590 INFO [RS:1;jenkins-hbase4:37679] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,604 INFO [RS:0;jenkins-hbase4:46079] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:34,605 INFO [RS:0;jenkins-hbase4:46079] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46079,1676566894264-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,606 INFO [RS:1;jenkins-hbase4:37679] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:34,606 INFO [RS:1;jenkins-hbase4:37679] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37679,1676566894287-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,620 INFO [RS:0;jenkins-hbase4:46079] regionserver.Replication(203): jenkins-hbase4.apache.org,46079,1676566894264 started 2023-02-16 17:01:34,620 INFO [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46079,1676566894264, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46079, sessionid=0x1005e1480420001 2023-02-16 17:01:34,627 INFO [RS:1;jenkins-hbase4:37679] regionserver.Replication(203): jenkins-hbase4.apache.org,37679,1676566894287 started 2023-02-16 17:01:34,627 DEBUG [RS:0;jenkins-hbase4:46079] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:34,627 INFO [RS:1;jenkins-hbase4:37679] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37679,1676566894287, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37679, sessionid=0x1005e1480420002 2023-02-16 17:01:34,627 DEBUG [RS:1;jenkins-hbase4:37679] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:34,627 DEBUG [RS:1;jenkins-hbase4:37679] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:34,627 DEBUG [RS:1;jenkins-hbase4:37679] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37679,1676566894287' 2023-02-16 17:01:34,627 DEBUG [RS:1;jenkins-hbase4:37679] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:34,628 DEBUG [RS:0;jenkins-hbase4:46079] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:34,628 DEBUG [RS:0;jenkins-hbase4:46079] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46079,1676566894264' 2023-02-16 17:01:34,628 DEBUG [RS:0;jenkins-hbase4:46079] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:34,628 DEBUG [RS:1;jenkins-hbase4:37679] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:34,628 DEBUG [RS:0;jenkins-hbase4:46079] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:34,628 DEBUG [RS:1;jenkins-hbase4:37679] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:34,629 DEBUG [RS:1;jenkins-hbase4:37679] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:34,629 DEBUG [RS:1;jenkins-hbase4:37679] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:34,629 DEBUG [RS:1;jenkins-hbase4:37679] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37679,1676566894287' 2023-02-16 17:01:34,629 DEBUG [RS:1;jenkins-hbase4:37679] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:34,629 DEBUG [RS:0;jenkins-hbase4:46079] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:34,629 DEBUG [RS:0;jenkins-hbase4:46079] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:34,629 DEBUG [RS:0;jenkins-hbase4:46079] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:34,629 DEBUG [RS:0;jenkins-hbase4:46079] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46079,1676566894264' 2023-02-16 17:01:34,629 DEBUG [RS:0;jenkins-hbase4:46079] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:34,629 DEBUG [RS:1;jenkins-hbase4:37679] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:34,629 DEBUG [RS:1;jenkins-hbase4:37679] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:34,629 INFO [RS:1;jenkins-hbase4:37679] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:34,630 INFO [RS:1;jenkins-hbase4:37679] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:34,629 DEBUG [RS:0;jenkins-hbase4:46079] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:34,630 DEBUG [RS:0;jenkins-hbase4:46079] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:34,630 INFO [RS:0;jenkins-hbase4:46079] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:34,630 INFO [RS:0;jenkins-hbase4:46079] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:34,630 DEBUG [jenkins-hbase4:40979] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 17:01:34,630 DEBUG [jenkins-hbase4:40979] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:34,632 DEBUG [jenkins-hbase4:40979] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:34,632 DEBUG [jenkins-hbase4:40979] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:34,632 DEBUG [jenkins-hbase4:40979] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:34,634 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46079,1676566894264, state=OPENING 2023-02-16 17:01:34,635 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 17:01:34,636 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:34,637 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:34,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46079,1676566894264}] 2023-02-16 17:01:34,792 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:34,792 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:34,794 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32970, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:34,798 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 17:01:34,798 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:34,800 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46079%2C1676566894264.meta, suffix=.meta, logDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/WALs/jenkins-hbase4.apache.org,46079,1676566894264, archiveDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/oldWALs, maxLogs=32 2023-02-16 17:01:34,816 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39293,DS-488e02d0-83a6-4330-bbd1-00bdae84c086,DISK] 2023-02-16 17:01:34,816 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34967,DS-cc38f951-7a6a-4806-8a2b-7c7a7c7dace0,DISK] 2023-02-16 17:01:34,817 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/WALs/jenkins-hbase4.apache.org,46079,1676566894264/jenkins-hbase4.apache.org%2C46079%2C1676566894264.meta.1676566894800.meta 2023-02-16 17:01:34,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39293,DS-488e02d0-83a6-4330-bbd1-00bdae84c086,DISK], DatanodeInfoWithStorage[127.0.0.1:34967,DS-cc38f951-7a6a-4806-8a2b-7c7a7c7dace0,DISK]] 2023-02-16 17:01:34,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:34,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 17:01:34,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 17:01:34,818 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 17:01:34,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 17:01:34,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:34,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 17:01:34,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 17:01:34,819 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:34,820 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/info 2023-02-16 17:01:34,820 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/info 2023-02-16 17:01:34,821 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:34,821 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:34,821 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:34,822 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:34,822 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:34,822 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:34,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:34,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:34,823 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/table 2023-02-16 17:01:34,823 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/table 2023-02-16 17:01:34,823 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:34,824 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:34,824 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740 2023-02-16 17:01:34,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740 2023-02-16 17:01:34,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:34,828 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:34,829 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64742323, jitterRate=-0.035264208912849426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:34,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:34,829 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676566894792 2023-02-16 17:01:34,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 17:01:34,835 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 17:01:34,835 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46079,1676566894264, state=OPEN 2023-02-16 17:01:34,837 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 17:01:34,837 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:34,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 17:01:34,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46079,1676566894264 in 200 msec 2023-02-16 17:01:34,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 17:01:34,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-02-16 17:01:34,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 416 msec 2023-02-16 17:01:34,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676566894842, completionTime=-1 2023-02-16 17:01:34,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 17:01:34,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 17:01:34,844 DEBUG [hconnection-0x4fc6a61a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:34,846 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32974, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:34,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 17:01:34,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676566954847 2023-02-16 17:01:34,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676567014847 2023-02-16 17:01:34,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-16 17:01:34,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40979,1676566894225-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40979,1676566894225-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40979,1676566894225-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40979, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:34,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 17:01:34,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:34,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 17:01:34,855 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 17:01:34,855 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:34,856 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:34,857 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db 2023-02-16 17:01:34,858 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db empty. 2023-02-16 17:01:34,858 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db 2023-02-16 17:01:34,858 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 17:01:34,867 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:34,868 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 338f9e7ea169ebafadd3bc65223e69db, NAME => 'hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp 2023-02-16 17:01:34,876 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:34,876 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 338f9e7ea169ebafadd3bc65223e69db, disabling compactions & flushes 2023-02-16 17:01:34,876 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. 2023-02-16 17:01:34,876 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. 2023-02-16 17:01:34,876 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. after waiting 0 ms 2023-02-16 17:01:34,876 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. 2023-02-16 17:01:34,876 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. 2023-02-16 17:01:34,876 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 338f9e7ea169ebafadd3bc65223e69db: 2023-02-16 17:01:34,879 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:34,880 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566894880"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566894880"}]},"ts":"1676566894880"} 2023-02-16 17:01:34,883 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 17:01:34,883 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:34,883 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566894883"}]},"ts":"1676566894883"} 2023-02-16 17:01:34,885 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 17:01:34,888 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:34,889 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:34,889 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:34,889 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:34,891 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=338f9e7ea169ebafadd3bc65223e69db, ASSIGN}] 2023-02-16 17:01:34,894 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=338f9e7ea169ebafadd3bc65223e69db, ASSIGN 2023-02-16 17:01:34,895 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=338f9e7ea169ebafadd3bc65223e69db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46079,1676566894264; forceNewPlan=false, retain=false 2023-02-16 17:01:35,045 INFO [jenkins-hbase4:40979] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 17:01:35,047 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=338f9e7ea169ebafadd3bc65223e69db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:35,047 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566895047"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566895047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566895047"}]},"ts":"1676566895047"} 2023-02-16 17:01:35,049 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 338f9e7ea169ebafadd3bc65223e69db, server=jenkins-hbase4.apache.org,46079,1676566894264}] 2023-02-16 17:01:35,206 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. 2023-02-16 17:01:35,208 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46079%2C1676566894264, suffix=, logDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/WALs/jenkins-hbase4.apache.org,46079,1676566894264, archiveDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/oldWALs, maxLogs=32 2023-02-16 17:01:35,229 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39293,DS-488e02d0-83a6-4330-bbd1-00bdae84c086,DISK] 2023-02-16 17:01:35,229 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34967,DS-cc38f951-7a6a-4806-8a2b-7c7a7c7dace0,DISK] 2023-02-16 17:01:35,231 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/WALs/jenkins-hbase4.apache.org,46079,1676566894264/jenkins-hbase4.apache.org%2C46079%2C1676566894264.1676566895208 2023-02-16 17:01:35,231 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39293,DS-488e02d0-83a6-4330-bbd1-00bdae84c086,DISK], DatanodeInfoWithStorage[127.0.0.1:34967,DS-cc38f951-7a6a-4806-8a2b-7c7a7c7dace0,DISK]] 2023-02-16 17:01:35,231 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 338f9e7ea169ebafadd3bc65223e69db, NAME => 'hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:35,231 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 338f9e7ea169ebafadd3bc65223e69db 2023-02-16 17:01:35,231 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:35,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 338f9e7ea169ebafadd3bc65223e69db 2023-02-16 17:01:35,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 338f9e7ea169ebafadd3bc65223e69db 2023-02-16 17:01:35,236 INFO [StoreOpener-338f9e7ea169ebafadd3bc65223e69db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 338f9e7ea169ebafadd3bc65223e69db 2023-02-16 17:01:35,237 DEBUG [StoreOpener-338f9e7ea169ebafadd3bc65223e69db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db/info 2023-02-16 17:01:35,237 DEBUG [StoreOpener-338f9e7ea169ebafadd3bc65223e69db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db/info 2023-02-16 17:01:35,238 INFO [StoreOpener-338f9e7ea169ebafadd3bc65223e69db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 338f9e7ea169ebafadd3bc65223e69db columnFamilyName info 2023-02-16 17:01:35,242 INFO [StoreOpener-338f9e7ea169ebafadd3bc65223e69db-1] regionserver.HStore(310): Store=338f9e7ea169ebafadd3bc65223e69db/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:35,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db 2023-02-16 17:01:35,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db 2023-02-16 17:01:35,246 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 338f9e7ea169ebafadd3bc65223e69db 2023-02-16 17:01:35,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:35,248 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 338f9e7ea169ebafadd3bc65223e69db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61550339, jitterRate=-0.08282847702503204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:35,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 338f9e7ea169ebafadd3bc65223e69db: 2023-02-16 17:01:35,249 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db., pid=6, masterSystemTime=1676566895201 2023-02-16 17:01:35,252 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. 2023-02-16 17:01:35,252 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. 2023-02-16 17:01:35,252 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=338f9e7ea169ebafadd3bc65223e69db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:35,252 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566895252"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566895252"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566895252"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566895252"}]},"ts":"1676566895252"} 2023-02-16 17:01:35,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 17:01:35,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 338f9e7ea169ebafadd3bc65223e69db, server=jenkins-hbase4.apache.org,46079,1676566894264 in 205 msec 2023-02-16 17:01:35,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 17:01:35,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=338f9e7ea169ebafadd3bc65223e69db, ASSIGN in 367 msec 2023-02-16 17:01:35,258 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:35,258 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566895258"}]},"ts":"1676566895258"} 2023-02-16 17:01:35,259 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 17:01:35,261 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:35,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 408 msec 2023-02-16 17:01:35,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 17:01:35,359 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:35,359 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:35,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 17:01:35,377 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:35,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 18 msec 2023-02-16 17:01:35,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 17:01:35,393 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:35,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-16 17:01:35,401 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 17:01:35,403 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 17:01:35,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.095sec 2023-02-16 17:01:35,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 17:01:35,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 17:01:35,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 17:01:35,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40979,1676566894225-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 17:01:35,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40979,1676566894225-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 17:01:35,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 17:01:35,502 DEBUG [Listener at localhost/35457] zookeeper.ReadOnlyZKClient(139): Connect 0x76e7a3a3 to 127.0.0.1:58835 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:35,506 DEBUG [Listener at localhost/35457] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@493f0611, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:35,508 DEBUG [hconnection-0x278ede24-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:35,509 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:35,511 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40979,1676566894225 2023-02-16 17:01:35,511 DEBUG [Listener at localhost/35457] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 17:01:35,512 DEBUG [Listener at localhost/35457] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 17:01:35,514 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55930, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 17:01:35,514 INFO [Listener at localhost/35457] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-16 17:01:35,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-16 17:01:35,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 17:01:35,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:55930 deadline: 1676566955514, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-16 17:01:35,515 INFO [Listener at localhost/35457] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-16 17:01:35,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:35,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:35,519 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:35,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-16 17:01:35,520 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:35,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:35,527 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:35,527 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:35,527 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:35,527 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:35,527 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:35,527 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:35,527 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:35,527 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15 2023-02-16 17:01:35,527 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d empty. 2023-02-16 17:01:35,527 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042 empty. 2023-02-16 17:01:35,528 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd empty. 2023-02-16 17:01:35,528 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b empty. 2023-02-16 17:01:35,528 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da empty. 2023-02-16 17:01:35,528 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1 empty. 2023-02-16 17:01:35,528 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2 empty. 2023-02-16 17:01:35,528 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:35,528 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:35,528 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:35,528 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:35,528 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:35,528 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:35,529 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:35,529 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15 empty. 2023-02-16 17:01:35,529 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:35,529 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:35,529 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546 empty. 2023-02-16 17:01:35,529 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7 empty. 2023-02-16 17:01:35,529 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15 2023-02-16 17:01:35,529 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:35,529 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:35,529 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-16 17:01:35,577 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 17:01:35,586 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:35,587 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b09ea274eee145a71c64e3229d5055da, NAME => 'testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp 2023-02-16 17:01:35,588 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2398758f270e0596d064983c250c0d15, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp 2023-02-16 17:01:35,590 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4062b4e8a179ed2266a585a9327bed5b, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp 2023-02-16 17:01:35,613 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:35,613 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:35,613 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 4062b4e8a179ed2266a585a9327bed5b, disabling compactions & flushes 2023-02-16 17:01:35,613 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing b09ea274eee145a71c64e3229d5055da, disabling compactions & flushes 2023-02-16 17:01:35,613 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:35,613 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:35,613 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:35,613 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:35,613 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. after waiting 0 ms 2023-02-16 17:01:35,613 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:35,613 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. after waiting 0 ms 2023-02-16 17:01:35,613 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:35,613 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:35,614 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for b09ea274eee145a71c64e3229d5055da: 2023-02-16 17:01:35,613 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:35,614 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 4062b4e8a179ed2266a585a9327bed5b: 2023-02-16 17:01:35,614 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8ecbd25752d0ce070f9f1e2abbd51042, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp 2023-02-16 17:01:35,614 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 20f3096d8125f78221b2488c69302ee2, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp 2023-02-16 17:01:35,617 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:35,617 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 2398758f270e0596d064983c250c0d15, disabling compactions & flushes 2023-02-16 17:01:35,617 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:35,617 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:35,617 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. after waiting 0 ms 2023-02-16 17:01:35,617 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:35,617 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:35,617 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 2398758f270e0596d064983c250c0d15: 2023-02-16 17:01:35,619 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7f1ae5a78fb89be58531d6f9228fa7c1, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp 2023-02-16 17:01:35,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:35,631 INFO [RS:1;jenkins-hbase4:37679] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37679%2C1676566894287, suffix=, logDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/WALs/jenkins-hbase4.apache.org,37679,1676566894287, archiveDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/oldWALs, maxLogs=32 2023-02-16 17:01:35,638 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:35,638 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 8ecbd25752d0ce070f9f1e2abbd51042, disabling compactions & flushes 2023-02-16 17:01:35,638 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:35,638 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:35,638 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. after waiting 0 ms 2023-02-16 17:01:35,638 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:35,638 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:35,638 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 8ecbd25752d0ce070f9f1e2abbd51042: 2023-02-16 17:01:35,639 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => d15bd7abda6f210b6c84a60fe43cafcd, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp 2023-02-16 17:01:35,642 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:35,642 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 20f3096d8125f78221b2488c69302ee2, disabling compactions & flushes 2023-02-16 17:01:35,642 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:35,643 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:35,643 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. after waiting 0 ms 2023-02-16 17:01:35,643 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:35,643 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:35,643 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 20f3096d8125f78221b2488c69302ee2: 2023-02-16 17:01:35,643 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 21f6114bd03361dc1260ae06183b3b7d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp 2023-02-16 17:01:35,663 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:35,663 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 7f1ae5a78fb89be58531d6f9228fa7c1, disabling compactions & flushes 2023-02-16 17:01:35,663 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:35,663 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:35,663 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. after waiting 0 ms 2023-02-16 17:01:35,664 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:35,664 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:35,664 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 7f1ae5a78fb89be58531d6f9228fa7c1: 2023-02-16 17:01:35,665 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 36df7543091f382b63ddb591c9cdf546, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp 2023-02-16 17:01:35,676 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34967,DS-cc38f951-7a6a-4806-8a2b-7c7a7c7dace0,DISK] 2023-02-16 17:01:35,676 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39293,DS-488e02d0-83a6-4330-bbd1-00bdae84c086,DISK] 2023-02-16 17:01:35,689 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:35,689 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 21f6114bd03361dc1260ae06183b3b7d, disabling compactions & flushes 2023-02-16 17:01:35,689 INFO [RS:1;jenkins-hbase4:37679] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/WALs/jenkins-hbase4.apache.org,37679,1676566894287/jenkins-hbase4.apache.org%2C37679%2C1676566894287.1676566895631 2023-02-16 17:01:35,689 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:35,689 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:35,689 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. after waiting 0 ms 2023-02-16 17:01:35,689 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:35,689 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:35,689 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 21f6114bd03361dc1260ae06183b3b7d: 2023-02-16 17:01:35,690 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => afa10271d99d82ea3d3e2e277659c6a7, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp 2023-02-16 17:01:35,697 DEBUG [RS:1;jenkins-hbase4:37679] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39293,DS-488e02d0-83a6-4330-bbd1-00bdae84c086,DISK], DatanodeInfoWithStorage[127.0.0.1:34967,DS-cc38f951-7a6a-4806-8a2b-7c7a7c7dace0,DISK]] 2023-02-16 17:01:35,720 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:35,720 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing d15bd7abda6f210b6c84a60fe43cafcd, disabling compactions & flushes 2023-02-16 17:01:35,720 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:35,720 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:35,720 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. after waiting 0 ms 2023-02-16 17:01:35,720 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:35,720 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:35,720 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for d15bd7abda6f210b6c84a60fe43cafcd: 2023-02-16 17:01:35,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:35,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 36df7543091f382b63ddb591c9cdf546, disabling compactions & flushes 2023-02-16 17:01:35,724 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:35,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:35,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. after waiting 0 ms 2023-02-16 17:01:35,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:35,724 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:35,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 36df7543091f382b63ddb591c9cdf546: 2023-02-16 17:01:35,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:35,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing afa10271d99d82ea3d3e2e277659c6a7, disabling compactions & flushes 2023-02-16 17:01:35,727 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:35,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:35,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. after waiting 0 ms 2023-02-16 17:01:35,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:35,727 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:35,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for afa10271d99d82ea3d3e2e277659c6a7: 2023-02-16 17:01:35,729 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:35,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676566895730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566895730"}]},"ts":"1676566895730"} 2023-02-16 17:01:35,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566895730"}]},"ts":"1676566895730"} 2023-02-16 17:01:35,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566895730"}]},"ts":"1676566895730"} 2023-02-16 17:01:35,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566895730"}]},"ts":"1676566895730"} 2023-02-16 17:01:35,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566895730"}]},"ts":"1676566895730"} 2023-02-16 17:01:35,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566895730"}]},"ts":"1676566895730"} 2023-02-16 17:01:35,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566895730"}]},"ts":"1676566895730"} 2023-02-16 17:01:35,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566895730"}]},"ts":"1676566895730"} 2023-02-16 17:01:35,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566895730"}]},"ts":"1676566895730"} 2023-02-16 17:01:35,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676566895730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566895730"}]},"ts":"1676566895730"} 2023-02-16 17:01:35,733 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-16 17:01:35,734 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:35,734 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566895734"}]},"ts":"1676566895734"} 2023-02-16 17:01:35,735 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-16 17:01:35,739 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:35,745 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:35,745 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:35,745 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:35,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b09ea274eee145a71c64e3229d5055da, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2398758f270e0596d064983c250c0d15, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4062b4e8a179ed2266a585a9327bed5b, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ecbd25752d0ce070f9f1e2abbd51042, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20f3096d8125f78221b2488c69302ee2, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f1ae5a78fb89be58531d6f9228fa7c1, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d15bd7abda6f210b6c84a60fe43cafcd, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21f6114bd03361dc1260ae06183b3b7d, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36df7543091f382b63ddb591c9cdf546, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afa10271d99d82ea3d3e2e277659c6a7, ASSIGN}] 2023-02-16 17:01:35,750 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2398758f270e0596d064983c250c0d15, ASSIGN 2023-02-16 17:01:35,750 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4062b4e8a179ed2266a585a9327bed5b, ASSIGN 2023-02-16 17:01:35,750 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b09ea274eee145a71c64e3229d5055da, ASSIGN 2023-02-16 17:01:35,750 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ecbd25752d0ce070f9f1e2abbd51042, ASSIGN 2023-02-16 17:01:35,751 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2398758f270e0596d064983c250c0d15, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46079,1676566894264; forceNewPlan=false, retain=false 2023-02-16 17:01:35,751 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4062b4e8a179ed2266a585a9327bed5b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37679,1676566894287; forceNewPlan=false, retain=false 2023-02-16 17:01:35,751 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b09ea274eee145a71c64e3229d5055da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46079,1676566894264; forceNewPlan=false, retain=false 2023-02-16 17:01:35,752 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ecbd25752d0ce070f9f1e2abbd51042, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37679,1676566894287; forceNewPlan=false, retain=false 2023-02-16 17:01:35,752 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afa10271d99d82ea3d3e2e277659c6a7, ASSIGN 2023-02-16 17:01:35,753 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36df7543091f382b63ddb591c9cdf546, ASSIGN 2023-02-16 17:01:35,753 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afa10271d99d82ea3d3e2e277659c6a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37679,1676566894287; forceNewPlan=false, retain=false 2023-02-16 17:01:35,753 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21f6114bd03361dc1260ae06183b3b7d, ASSIGN 2023-02-16 17:01:35,753 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f1ae5a78fb89be58531d6f9228fa7c1, ASSIGN 2023-02-16 17:01:35,753 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d15bd7abda6f210b6c84a60fe43cafcd, ASSIGN 2023-02-16 17:01:35,754 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36df7543091f382b63ddb591c9cdf546, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46079,1676566894264; forceNewPlan=false, retain=false 2023-02-16 17:01:35,754 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f1ae5a78fb89be58531d6f9228fa7c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37679,1676566894287; forceNewPlan=false, retain=false 2023-02-16 17:01:35,754 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21f6114bd03361dc1260ae06183b3b7d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46079,1676566894264; forceNewPlan=false, retain=false 2023-02-16 17:01:35,754 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d15bd7abda6f210b6c84a60fe43cafcd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37679,1676566894287; forceNewPlan=false, retain=false 2023-02-16 17:01:35,754 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20f3096d8125f78221b2488c69302ee2, ASSIGN 2023-02-16 17:01:35,755 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20f3096d8125f78221b2488c69302ee2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46079,1676566894264; forceNewPlan=false, retain=false 2023-02-16 17:01:35,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:35,901 INFO [jenkins-hbase4:40979] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-16 17:01:35,907 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=36df7543091f382b63ddb591c9cdf546, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:35,907 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=20f3096d8125f78221b2488c69302ee2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:35,907 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=21f6114bd03361dc1260ae06183b3b7d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:35,907 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=2398758f270e0596d064983c250c0d15, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:35,907 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566895907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566895907"}]},"ts":"1676566895907"} 2023-02-16 17:01:35,907 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566895907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566895907"}]},"ts":"1676566895907"} 2023-02-16 17:01:35,907 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b09ea274eee145a71c64e3229d5055da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:35,907 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566895907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566895907"}]},"ts":"1676566895907"} 2023-02-16 17:01:35,908 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676566895907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566895907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566895907"}]},"ts":"1676566895907"} 2023-02-16 17:01:35,907 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566895907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566895907"}]},"ts":"1676566895907"} 2023-02-16 17:01:35,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=12, state=RUNNABLE; OpenRegionProcedure 2398758f270e0596d064983c250c0d15, server=jenkins-hbase4.apache.org,46079,1676566894264}] 2023-02-16 17:01:35,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=18, state=RUNNABLE; OpenRegionProcedure 21f6114bd03361dc1260ae06183b3b7d, server=jenkins-hbase4.apache.org,46079,1676566894264}] 2023-02-16 17:01:35,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure 20f3096d8125f78221b2488c69302ee2, server=jenkins-hbase4.apache.org,46079,1676566894264}] 2023-02-16 17:01:35,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure b09ea274eee145a71c64e3229d5055da, server=jenkins-hbase4.apache.org,46079,1676566894264}] 2023-02-16 17:01:35,911 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure 36df7543091f382b63ddb591c9cdf546, server=jenkins-hbase4.apache.org,46079,1676566894264}] 2023-02-16 17:01:35,912 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7f1ae5a78fb89be58531d6f9228fa7c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:35,912 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895912"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566895912"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566895912"}]},"ts":"1676566895912"} 2023-02-16 17:01:35,912 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4062b4e8a179ed2266a585a9327bed5b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:35,912 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895912"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566895912"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566895912"}]},"ts":"1676566895912"} 2023-02-16 17:01:35,913 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d15bd7abda6f210b6c84a60fe43cafcd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:35,913 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895913"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566895913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566895913"}]},"ts":"1676566895913"} 2023-02-16 17:01:35,914 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=16, state=RUNNABLE; OpenRegionProcedure 7f1ae5a78fb89be58531d6f9228fa7c1, server=jenkins-hbase4.apache.org,37679,1676566894287}] 2023-02-16 17:01:35,914 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=afa10271d99d82ea3d3e2e277659c6a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:35,914 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676566895914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566895914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566895914"}]},"ts":"1676566895914"} 2023-02-16 17:01:35,914 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8ecbd25752d0ce070f9f1e2abbd51042, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:35,914 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566895914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566895914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566895914"}]},"ts":"1676566895914"} 2023-02-16 17:01:35,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=13, state=RUNNABLE; OpenRegionProcedure 4062b4e8a179ed2266a585a9327bed5b, server=jenkins-hbase4.apache.org,37679,1676566894287}] 2023-02-16 17:01:35,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure d15bd7abda6f210b6c84a60fe43cafcd, server=jenkins-hbase4.apache.org,37679,1676566894287}] 2023-02-16 17:01:35,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=20, state=RUNNABLE; OpenRegionProcedure afa10271d99d82ea3d3e2e277659c6a7, server=jenkins-hbase4.apache.org,37679,1676566894287}] 2023-02-16 17:01:35,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure 8ecbd25752d0ce070f9f1e2abbd51042, server=jenkins-hbase4.apache.org,37679,1676566894287}] 2023-02-16 17:01:36,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:36,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 36df7543091f382b63ddb591c9cdf546, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-16 17:01:36,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:36,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:36,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:36,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:36,065 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:36,065 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:36,066 INFO [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:36,067 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54040, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:36,067 DEBUG [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1 2023-02-16 17:01:36,067 DEBUG [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1 2023-02-16 17:01:36,067 INFO [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36df7543091f382b63ddb591c9cdf546 columnFamilyName f1 2023-02-16 17:01:36,068 INFO [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] regionserver.HStore(310): Store=36df7543091f382b63ddb591c9cdf546/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,068 INFO [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:36,069 DEBUG [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2 2023-02-16 17:01:36,069 DEBUG [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2 2023-02-16 17:01:36,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:36,069 INFO [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36df7543091f382b63ddb591c9cdf546 columnFamilyName f2 2023-02-16 17:01:36,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7f1ae5a78fb89be58531d6f9228fa7c1, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-16 17:01:36,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:36,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:36,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:36,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:36,070 INFO [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] regionserver.HStore(310): Store=36df7543091f382b63ddb591c9cdf546/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:36,071 INFO [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:36,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:36,072 DEBUG [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1 2023-02-16 17:01:36,072 DEBUG [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1 2023-02-16 17:01:36,072 INFO [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f1ae5a78fb89be58531d6f9228fa7c1 columnFamilyName f1 2023-02-16 17:01:36,072 INFO [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] regionserver.HStore(310): Store=7f1ae5a78fb89be58531d6f9228fa7c1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,072 INFO [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:36,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:36,074 DEBUG [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2 2023-02-16 17:01:36,074 DEBUG [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2 2023-02-16 17:01:36,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:36,074 INFO [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f1ae5a78fb89be58531d6f9228fa7c1 columnFamilyName f2 2023-02-16 17:01:36,074 INFO [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] regionserver.HStore(310): Store=7f1ae5a78fb89be58531d6f9228fa7c1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:36,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:36,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:36,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 36df7543091f382b63ddb591c9cdf546; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63570069, jitterRate=-0.05273215472698212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:36,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 36df7543091f382b63ddb591c9cdf546: 2023-02-16 17:01:36,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546., pid=25, masterSystemTime=1676566896061 2023-02-16 17:01:36,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:36,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:36,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:36,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:36,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:36,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b09ea274eee145a71c64e3229d5055da, NAME => 'testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-16 17:01:36,079 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=36df7543091f382b63ddb591c9cdf546, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:36,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:36,079 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566896079"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566896079"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566896079"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566896079"}]},"ts":"1676566896079"} 2023-02-16 17:01:36,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:36,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:36,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:36,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-16 17:01:36,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure 36df7543091f382b63ddb591c9cdf546, server=jenkins-hbase4.apache.org,46079,1676566894264 in 170 msec 2023-02-16 17:01:36,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36df7543091f382b63ddb591c9cdf546, ASSIGN in 336 msec 2023-02-16 17:01:36,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:36,084 INFO [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:36,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7f1ae5a78fb89be58531d6f9228fa7c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67999581, jitterRate=0.013272717595100403}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:36,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7f1ae5a78fb89be58531d6f9228fa7c1: 2023-02-16 17:01:36,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1., pid=26, masterSystemTime=1676566896065 2023-02-16 17:01:36,085 DEBUG [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/f1 2023-02-16 17:01:36,087 DEBUG [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/f1 2023-02-16 17:01:36,087 INFO [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b09ea274eee145a71c64e3229d5055da columnFamilyName f1 2023-02-16 17:01:36,087 INFO [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] regionserver.HStore(310): Store=b09ea274eee145a71c64e3229d5055da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,087 INFO [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:36,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:36,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:36,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:36,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => afa10271d99d82ea3d3e2e277659c6a7, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-16 17:01:36,088 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7f1ae5a78fb89be58531d6f9228fa7c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:36,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:36,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:36,089 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566896088"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566896088"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566896088"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566896088"}]},"ts":"1676566896088"} 2023-02-16 17:01:36,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:36,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:36,089 DEBUG [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/f2 2023-02-16 17:01:36,089 DEBUG [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/f2 2023-02-16 17:01:36,089 INFO [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b09ea274eee145a71c64e3229d5055da columnFamilyName f2 2023-02-16 17:01:36,090 INFO [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] regionserver.HStore(310): Store=b09ea274eee145a71c64e3229d5055da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,090 INFO [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:36,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:36,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:36,091 DEBUG [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/f1 2023-02-16 17:01:36,091 DEBUG [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/f1 2023-02-16 17:01:36,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=16 2023-02-16 17:01:36,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=16, state=SUCCESS; OpenRegionProcedure 7f1ae5a78fb89be58531d6f9228fa7c1, server=jenkins-hbase4.apache.org,37679,1676566894287 in 177 msec 2023-02-16 17:01:36,092 INFO [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afa10271d99d82ea3d3e2e277659c6a7 columnFamilyName f1 2023-02-16 17:01:36,092 INFO [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] regionserver.HStore(310): Store=afa10271d99d82ea3d3e2e277659c6a7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,092 INFO [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:36,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:36,092 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f1ae5a78fb89be58531d6f9228fa7c1, ASSIGN in 345 msec 2023-02-16 17:01:36,093 DEBUG [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/f2 2023-02-16 17:01:36,093 DEBUG [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/f2 2023-02-16 17:01:36,094 INFO [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afa10271d99d82ea3d3e2e277659c6a7 columnFamilyName f2 2023-02-16 17:01:36,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:36,094 INFO [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] regionserver.HStore(310): Store=afa10271d99d82ea3d3e2e277659c6a7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:36,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:36,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:36,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b09ea274eee145a71c64e3229d5055da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68906188, jitterRate=0.026782214641571045}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:36,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b09ea274eee145a71c64e3229d5055da: 2023-02-16 17:01:36,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da., pid=24, masterSystemTime=1676566896061 2023-02-16 17:01:36,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:36,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:36,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:36,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:36,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 21f6114bd03361dc1260ae06183b3b7d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-16 17:01:36,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:36,098 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b09ea274eee145a71c64e3229d5055da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:36,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:36,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:36,098 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676566896098"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566896098"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566896098"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566896098"}]},"ts":"1676566896098"} 2023-02-16 17:01:36,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:36,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:36,100 INFO [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:36,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:36,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened afa10271d99d82ea3d3e2e277659c6a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74377279, jitterRate=0.10830782353878021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:36,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for afa10271d99d82ea3d3e2e277659c6a7: 2023-02-16 17:01:36,101 DEBUG [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1 2023-02-16 17:01:36,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7., pid=29, masterSystemTime=1676566896065 2023-02-16 17:01:36,101 DEBUG [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1 2023-02-16 17:01:36,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-16 17:01:36,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure b09ea274eee145a71c64e3229d5055da, server=jenkins-hbase4.apache.org,46079,1676566894264 in 189 msec 2023-02-16 17:01:36,101 INFO [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21f6114bd03361dc1260ae06183b3b7d columnFamilyName f1 2023-02-16 17:01:36,102 INFO [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] regionserver.HStore(310): Store=21f6114bd03361dc1260ae06183b3b7d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,102 INFO [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:36,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b09ea274eee145a71c64e3229d5055da, ASSIGN in 355 msec 2023-02-16 17:01:36,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:36,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:36,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:36,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d15bd7abda6f210b6c84a60fe43cafcd, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-16 17:01:36,102 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=afa10271d99d82ea3d3e2e277659c6a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:36,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:36,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:36,103 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676566896102"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566896102"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566896102"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566896102"}]},"ts":"1676566896102"} 2023-02-16 17:01:36,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:36,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:36,103 DEBUG [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2 2023-02-16 17:01:36,103 DEBUG [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2 2023-02-16 17:01:36,103 INFO [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21f6114bd03361dc1260ae06183b3b7d columnFamilyName f2 2023-02-16 17:01:36,104 INFO [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] regionserver.HStore(310): Store=21f6114bd03361dc1260ae06183b3b7d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,104 INFO [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:36,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:36,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:36,105 DEBUG [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1 2023-02-16 17:01:36,105 DEBUG [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1 2023-02-16 17:01:36,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=20 2023-02-16 17:01:36,105 INFO [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d15bd7abda6f210b6c84a60fe43cafcd columnFamilyName f1 2023-02-16 17:01:36,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=20, state=SUCCESS; OpenRegionProcedure afa10271d99d82ea3d3e2e277659c6a7, server=jenkins-hbase4.apache.org,37679,1676566894287 in 188 msec 2023-02-16 17:01:36,106 INFO [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] regionserver.HStore(310): Store=d15bd7abda6f210b6c84a60fe43cafcd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,106 INFO [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:36,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afa10271d99d82ea3d3e2e277659c6a7, ASSIGN in 359 msec 2023-02-16 17:01:36,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:36,107 DEBUG [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2 2023-02-16 17:01:36,107 DEBUG [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2 2023-02-16 17:01:36,107 INFO [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d15bd7abda6f210b6c84a60fe43cafcd columnFamilyName f2 2023-02-16 17:01:36,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:36,108 INFO [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] regionserver.HStore(310): Store=d15bd7abda6f210b6c84a60fe43cafcd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:36,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:36,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:36,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 21f6114bd03361dc1260ae06183b3b7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70039650, jitterRate=0.043672114610672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:36,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 21f6114bd03361dc1260ae06183b3b7d: 2023-02-16 17:01:36,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d., pid=22, masterSystemTime=1676566896061 2023-02-16 17:01:36,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:36,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:36,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:36,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:36,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 20f3096d8125f78221b2488c69302ee2, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-16 17:01:36,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:36,111 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=21f6114bd03361dc1260ae06183b3b7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:36,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:36,111 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566896111"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566896111"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566896111"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566896111"}]},"ts":"1676566896111"} 2023-02-16 17:01:36,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:36,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:36,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:36,113 INFO [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:36,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:36,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d15bd7abda6f210b6c84a60fe43cafcd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69430055, jitterRate=0.034588441252708435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:36,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d15bd7abda6f210b6c84a60fe43cafcd: 2023-02-16 17:01:36,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd., pid=28, masterSystemTime=1676566896065 2023-02-16 17:01:36,114 DEBUG [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1 2023-02-16 17:01:36,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=18 2023-02-16 17:01:36,114 DEBUG [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1 2023-02-16 17:01:36,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=18, state=SUCCESS; OpenRegionProcedure 21f6114bd03361dc1260ae06183b3b7d, server=jenkins-hbase4.apache.org,46079,1676566894264 in 203 msec 2023-02-16 17:01:36,114 INFO [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20f3096d8125f78221b2488c69302ee2 columnFamilyName f1 2023-02-16 17:01:36,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:36,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21f6114bd03361dc1260ae06183b3b7d, ASSIGN in 368 msec 2023-02-16 17:01:36,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:36,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:36,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4062b4e8a179ed2266a585a9327bed5b, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-16 17:01:36,116 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d15bd7abda6f210b6c84a60fe43cafcd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:36,116 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566896116"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566896116"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566896116"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566896116"}]},"ts":"1676566896116"} 2023-02-16 17:01:36,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:36,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:36,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:36,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:36,117 INFO [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:36,118 INFO [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] regionserver.HStore(310): Store=20f3096d8125f78221b2488c69302ee2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,118 INFO [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:36,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-16 17:01:36,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure d15bd7abda6f210b6c84a60fe43cafcd, server=jenkins-hbase4.apache.org,37679,1676566894287 in 202 msec 2023-02-16 17:01:36,120 DEBUG [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2 2023-02-16 17:01:36,120 DEBUG [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2 2023-02-16 17:01:36,120 DEBUG [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1 2023-02-16 17:01:36,120 DEBUG [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1 2023-02-16 17:01:36,120 INFO [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20f3096d8125f78221b2488c69302ee2 columnFamilyName f2 2023-02-16 17:01:36,120 INFO [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4062b4e8a179ed2266a585a9327bed5b columnFamilyName f1 2023-02-16 17:01:36,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d15bd7abda6f210b6c84a60fe43cafcd, ASSIGN in 373 msec 2023-02-16 17:01:36,120 INFO [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] regionserver.HStore(310): Store=4062b4e8a179ed2266a585a9327bed5b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,120 INFO [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] regionserver.HStore(310): Store=20f3096d8125f78221b2488c69302ee2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,121 INFO [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:36,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:36,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:36,122 DEBUG [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2 2023-02-16 17:01:36,122 DEBUG [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2 2023-02-16 17:01:36,122 INFO [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4062b4e8a179ed2266a585a9327bed5b columnFamilyName f2 2023-02-16 17:01:36,122 INFO [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] regionserver.HStore(310): Store=4062b4e8a179ed2266a585a9327bed5b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:36,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:36,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:36,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:36,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:36,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:36,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:36,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 20f3096d8125f78221b2488c69302ee2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64846560, jitterRate=-0.03371095657348633}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:36,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 20f3096d8125f78221b2488c69302ee2: 2023-02-16 17:01:36,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:36,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2., pid=23, masterSystemTime=1676566896061 2023-02-16 17:01:36,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:36,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:36,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:36,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2398758f270e0596d064983c250c0d15, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-16 17:01:36,129 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=20f3096d8125f78221b2488c69302ee2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:36,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2398758f270e0596d064983c250c0d15 2023-02-16 17:01:36,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:36,129 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566896129"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566896129"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566896129"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566896129"}]},"ts":"1676566896129"} 2023-02-16 17:01:36,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2398758f270e0596d064983c250c0d15 2023-02-16 17:01:36,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2398758f270e0596d064983c250c0d15 2023-02-16 17:01:36,131 INFO [StoreOpener-2398758f270e0596d064983c250c0d15-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2398758f270e0596d064983c250c0d15 2023-02-16 17:01:36,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:36,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4062b4e8a179ed2266a585a9327bed5b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64546207, jitterRate=-0.03818656504154205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:36,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4062b4e8a179ed2266a585a9327bed5b: 2023-02-16 17:01:36,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-16 17:01:36,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure 20f3096d8125f78221b2488c69302ee2, server=jenkins-hbase4.apache.org,46079,1676566894264 in 221 msec 2023-02-16 17:01:36,133 DEBUG [StoreOpener-2398758f270e0596d064983c250c0d15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1 2023-02-16 17:01:36,133 DEBUG [StoreOpener-2398758f270e0596d064983c250c0d15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1 2023-02-16 17:01:36,133 INFO [StoreOpener-2398758f270e0596d064983c250c0d15-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2398758f270e0596d064983c250c0d15 columnFamilyName f1 2023-02-16 17:01:36,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b., pid=27, masterSystemTime=1676566896065 2023-02-16 17:01:36,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20f3096d8125f78221b2488c69302ee2, ASSIGN in 386 msec 2023-02-16 17:01:36,134 INFO [StoreOpener-2398758f270e0596d064983c250c0d15-1] regionserver.HStore(310): Store=2398758f270e0596d064983c250c0d15/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,134 INFO [StoreOpener-2398758f270e0596d064983c250c0d15-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2398758f270e0596d064983c250c0d15 2023-02-16 17:01:36,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:36,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:36,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:36,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8ecbd25752d0ce070f9f1e2abbd51042, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-16 17:01:36,135 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4062b4e8a179ed2266a585a9327bed5b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:36,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:36,135 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566896135"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566896135"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566896135"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566896135"}]},"ts":"1676566896135"} 2023-02-16 17:01:36,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:36,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:36,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:36,136 DEBUG [StoreOpener-2398758f270e0596d064983c250c0d15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2 2023-02-16 17:01:36,136 DEBUG [StoreOpener-2398758f270e0596d064983c250c0d15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2 2023-02-16 17:01:36,136 INFO [StoreOpener-2398758f270e0596d064983c250c0d15-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2398758f270e0596d064983c250c0d15 columnFamilyName f2 2023-02-16 17:01:36,137 INFO [StoreOpener-2398758f270e0596d064983c250c0d15-1] regionserver.HStore(310): Store=2398758f270e0596d064983c250c0d15/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15 2023-02-16 17:01:36,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15 2023-02-16 17:01:36,138 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=13 2023-02-16 17:01:36,138 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=13, state=SUCCESS; OpenRegionProcedure 4062b4e8a179ed2266a585a9327bed5b, server=jenkins-hbase4.apache.org,37679,1676566894287 in 223 msec 2023-02-16 17:01:36,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4062b4e8a179ed2266a585a9327bed5b, ASSIGN in 392 msec 2023-02-16 17:01:36,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:36,140 INFO [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:36,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2398758f270e0596d064983c250c0d15 2023-02-16 17:01:36,141 DEBUG [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1 2023-02-16 17:01:36,141 DEBUG [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1 2023-02-16 17:01:36,141 INFO [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ecbd25752d0ce070f9f1e2abbd51042 columnFamilyName f1 2023-02-16 17:01:36,142 INFO [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] regionserver.HStore(310): Store=8ecbd25752d0ce070f9f1e2abbd51042/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:36,142 INFO [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:36,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2398758f270e0596d064983c250c0d15; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75162654, jitterRate=0.12001082301139832}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:36,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2398758f270e0596d064983c250c0d15: 2023-02-16 17:01:36,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15., pid=21, masterSystemTime=1676566896061 2023-02-16 17:01:36,143 DEBUG [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2 2023-02-16 17:01:36,143 DEBUG [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2 2023-02-16 17:01:36,143 INFO [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ecbd25752d0ce070f9f1e2abbd51042 columnFamilyName f2 2023-02-16 17:01:36,144 INFO [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] regionserver.HStore(310): Store=8ecbd25752d0ce070f9f1e2abbd51042/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:36,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:36,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:36,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:36,145 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=2398758f270e0596d064983c250c0d15, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:36,145 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566896145"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566896145"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566896145"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566896145"}]},"ts":"1676566896145"} 2023-02-16 17:01:36,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:36,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:36,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=12 2023-02-16 17:01:36,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=12, state=SUCCESS; OpenRegionProcedure 2398758f270e0596d064983c250c0d15, server=jenkins-hbase4.apache.org,46079,1676566894264 in 237 msec 2023-02-16 17:01:36,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:36,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2398758f270e0596d064983c250c0d15, ASSIGN in 401 msec 2023-02-16 17:01:36,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:36,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8ecbd25752d0ce070f9f1e2abbd51042; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70537856, jitterRate=0.05109596252441406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:36,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8ecbd25752d0ce070f9f1e2abbd51042: 2023-02-16 17:01:36,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042., pid=30, masterSystemTime=1676566896065 2023-02-16 17:01:36,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:36,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:36,152 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8ecbd25752d0ce070f9f1e2abbd51042, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:36,152 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566896152"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566896152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566896152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566896152"}]},"ts":"1676566896152"} 2023-02-16 17:01:36,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-16 17:01:36,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure 8ecbd25752d0ce070f9f1e2abbd51042, server=jenkins-hbase4.apache.org,37679,1676566894287 in 236 msec 2023-02-16 17:01:36,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=10 2023-02-16 17:01:36,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ecbd25752d0ce070f9f1e2abbd51042, ASSIGN in 409 msec 2023-02-16 17:01:36,157 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:36,157 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566896157"}]},"ts":"1676566896157"} 2023-02-16 17:01:36,158 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-16 17:01:36,160 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:36,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 643 msec 2023-02-16 17:01:36,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:36,626 INFO [Listener at localhost/35457] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-16 17:01:36,626 DEBUG [Listener at localhost/35457] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-16 17:01:36,626 INFO [Listener at localhost/35457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:36,629 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-16 17:01:36,629 INFO [Listener at localhost/35457] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:36,629 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-16 17:01:36,629 INFO [Listener at localhost/35457] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 17:01:36,662 DEBUG [hconnection-0x278ede24-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:36,674 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54050, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:36,678 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46079] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:36,681 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37679] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:36,744 INFO [Listener at localhost/35457] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 17:01:36,744 INFO [Listener at localhost/35457] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 17:01:36,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 17:01:36,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676566896745 (current time:1676566896745). 2023-02-16 17:01:36,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 17:01:36,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] zookeeper.ReadOnlyZKClient(139): Connect 0x51f39934 to 127.0.0.1:58835 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:36,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2afce2f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:36,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:36,809 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:36,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51f39934 to 127.0.0.1:58835 2023-02-16 17:01:36,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:36,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 17:01:36,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 17:01:36,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 17:01:36,813 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 17:01:36,862 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676567496862 2023-02-16 17:01:36,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-16 17:01:36,862 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,863 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:36,863 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 17:01:36,864 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-16 17:01:36,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 17:01:36,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 52 msec 2023-02-16 17:01:36,866 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 17:01:36,866 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676567496866 2023-02-16 17:01:36,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,877 INFO [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-16 17:01:36,877 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:36,878 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-16 17:01:36,878 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 17:01:36,878 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,878 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,929 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:36,929 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:36,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:36,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:36,929 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:36,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:36,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:36,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,930 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:36,930 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:36,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,930 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:36,930 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:36,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-16 17:01:36,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-16 17:01:36,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,930 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-16 17:01:36,931 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-16 17:01:36,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,931 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-16 17:01:36,931 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:36,931 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-16 17:01:36,933 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 17:01:36,933 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 17:01:36,933 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:36,933 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46079,1676566894264' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 17:01:36,933 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 17:01:36,933 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 17:01:36,933 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37679,1676566894287' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 17:01:36,964 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:36,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 17:01:36,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:36,965 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 17:01:36,991 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:36,991 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:37,037 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:37,037 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,038 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:37,037 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:37,038 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,038 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:37,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:37,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46079,1676566894264' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 17:01:37,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fcaa676[Count = 1] remaining members to acquire global barrier 2023-02-16 17:01:37,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:37,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37679,1676566894287' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 17:01:37,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fcaa676[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:37,041 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 17:01:37,041 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,107 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,107 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,107 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,107 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 17:01:37,107 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 17:01:37,108 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:37,108 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. started... 2023-02-16 17:01:37,108 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,108 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:37,108 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:37,108 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:37,108 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:37,108 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d15bd7abda6f210b6c84a60fe43cafcd 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:37,108 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. started... 2023-02-16 17:01:37,109 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:37,108 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 17:01:37,109 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b09ea274eee145a71c64e3229d5055da: 2023-02-16 17:01:37,108 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. started... 2023-02-16 17:01:37,109 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 17:01:37,109 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. started... 2023-02-16 17:01:37,110 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,108 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:37,110 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4062b4e8a179ed2266a585a9327bed5b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:37,108 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-16 17:01:37,110 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 17:01:37,108 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. started... 2023-02-16 17:01:37,110 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. started... 2023-02-16 17:01:37,110 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:37,111 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for afa10271d99d82ea3d3e2e277659c6a7: 2023-02-16 17:01:37,111 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 17:01:37,112 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 20f3096d8125f78221b2488c69302ee2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:37,110 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2398758f270e0596d064983c250c0d15 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 17:01:37,112 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,112 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 17:01:37,112 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:37,113 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 17:01:37,113 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-16 17:01:37,127 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. completed. 2023-02-16 17:01:37,127 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:37,127 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:37,127 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 17:01:37,127 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. started... 2023-02-16 17:01:37,139 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/.tmp/f1/e0909d7aeb5449108f61076acb02c2e0 2023-02-16 17:01:37,141 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 36df7543091f382b63ddb591c9cdf546 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-16 17:01:37,141 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. completed. 2023-02-16 17:01:37,141 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:37,141 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:37,141 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-16 17:01:37,141 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. started... 2023-02-16 17:01:37,143 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 8ecbd25752d0ce070f9f1e2abbd51042 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:37,143 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/.tmp/f1/906bc1a749d14342b90880c0a55de542 2023-02-16 17:01:37,149 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/.tmp/f1/46c526f55f9244f29ab116bbe12e8698 2023-02-16 17:01:37,153 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/.tmp/f1/06abc8e2a27f489696ec5970c74c3061 2023-02-16 17:01:37,166 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:37,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 17:01:37,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:37,167 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-16 17:01:37,195 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/.tmp/f1/bbeb55e767584d549860cfef265a0aa8 2023-02-16 17:01:37,196 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/.tmp/f1/547dd8c427054793812891ef6f859ead 2023-02-16 17:01:37,211 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/.tmp/f2/da7f3cf9b1e24b509bec089c93ae9b67 2023-02-16 17:01:37,212 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/.tmp/f2/269eca8f847448a2b1fa9b585b1b04f9 2023-02-16 17:01:37,215 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/.tmp/f2/9f170425c46345a49350eec31a105e2f 2023-02-16 17:01:37,218 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/.tmp/f1/46c526f55f9244f29ab116bbe12e8698 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1/46c526f55f9244f29ab116bbe12e8698 2023-02-16 17:01:37,219 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/.tmp/f2/b682ab39e8964a6e8340665d6c821f62 2023-02-16 17:01:37,219 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/.tmp/f2/da1eee2429ab4f179a0d44904a1ec07c 2023-02-16 17:01:37,220 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/.tmp/f1/06abc8e2a27f489696ec5970c74c3061 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1/06abc8e2a27f489696ec5970c74c3061 2023-02-16 17:01:37,221 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/.tmp/f2/8aaad5806f374b4ebaedc1b179de79e8 2023-02-16 17:01:37,222 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/.tmp/f1/e0909d7aeb5449108f61076acb02c2e0 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1/e0909d7aeb5449108f61076acb02c2e0 2023-02-16 17:01:37,227 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/.tmp/f1/906bc1a749d14342b90880c0a55de542 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1/906bc1a749d14342b90880c0a55de542 2023-02-16 17:01:37,228 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1/06abc8e2a27f489696ec5970c74c3061, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:37,229 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/.tmp/f1/547dd8c427054793812891ef6f859ead as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1/547dd8c427054793812891ef6f859ead 2023-02-16 17:01:37,229 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/.tmp/f2/269eca8f847448a2b1fa9b585b1b04f9 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2/269eca8f847448a2b1fa9b585b1b04f9 2023-02-16 17:01:37,229 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/.tmp/f1/bbeb55e767584d549860cfef265a0aa8 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1/bbeb55e767584d549860cfef265a0aa8 2023-02-16 17:01:37,230 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1/46c526f55f9244f29ab116bbe12e8698, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 17:01:37,231 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/.tmp/f2/da7f3cf9b1e24b509bec089c93ae9b67 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2/da7f3cf9b1e24b509bec089c93ae9b67 2023-02-16 17:01:37,232 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1/e0909d7aeb5449108f61076acb02c2e0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:37,236 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2/269eca8f847448a2b1fa9b585b1b04f9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:37,237 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 20f3096d8125f78221b2488c69302ee2 in 125ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:37,237 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-16 17:01:37,238 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2/da7f3cf9b1e24b509bec089c93ae9b67, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 17:01:37,238 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 20f3096d8125f78221b2488c69302ee2: 2023-02-16 17:01:37,238 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,238 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:37,238 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1/06abc8e2a27f489696ec5970c74c3061] hfiles 2023-02-16 17:01:37,238 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1/06abc8e2a27f489696ec5970c74c3061 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,239 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2/269eca8f847448a2b1fa9b585b1b04f9] hfiles 2023-02-16 17:01:37,239 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2/269eca8f847448a2b1fa9b585b1b04f9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,239 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 2398758f270e0596d064983c250c0d15 in 129ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:37,241 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2398758f270e0596d064983c250c0d15: 2023-02-16 17:01:37,241 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,241 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:37,241 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1/46c526f55f9244f29ab116bbe12e8698] hfiles 2023-02-16 17:01:37,241 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1/46c526f55f9244f29ab116bbe12e8698 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,241 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2/da7f3cf9b1e24b509bec089c93ae9b67] hfiles 2023-02-16 17:01:37,241 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2/da7f3cf9b1e24b509bec089c93ae9b67 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,242 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1/547dd8c427054793812891ef6f859ead, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 17:01:37,243 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/.tmp/f2/b682ab39e8964a6e8340665d6c821f62 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2/b682ab39e8964a6e8340665d6c821f62 2023-02-16 17:01:37,244 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/.tmp/f2/9f170425c46345a49350eec31a105e2f as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2/9f170425c46345a49350eec31a105e2f 2023-02-16 17:01:37,247 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1/906bc1a749d14342b90880c0a55de542, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:37,248 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/.tmp/f2/da1eee2429ab4f179a0d44904a1ec07c as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2/da1eee2429ab4f179a0d44904a1ec07c 2023-02-16 17:01:37,258 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1/bbeb55e767584d549860cfef265a0aa8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:37,258 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2/b682ab39e8964a6e8340665d6c821f62, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-16 17:01:37,258 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/.tmp/f2/8aaad5806f374b4ebaedc1b179de79e8 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2/8aaad5806f374b4ebaedc1b179de79e8 2023-02-16 17:01:37,258 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 36df7543091f382b63ddb591c9cdf546 in 117ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:37,259 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 36df7543091f382b63ddb591c9cdf546: 2023-02-16 17:01:37,259 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,259 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:37,259 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1/547dd8c427054793812891ef6f859ead] hfiles 2023-02-16 17:01:37,259 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1/547dd8c427054793812891ef6f859ead for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,259 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2/b682ab39e8964a6e8340665d6c821f62] hfiles 2023-02-16 17:01:37,259 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2/b682ab39e8964a6e8340665d6c821f62 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,266 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2/da1eee2429ab4f179a0d44904a1ec07c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:37,267 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d15bd7abda6f210b6c84a60fe43cafcd in 159ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:37,267 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d15bd7abda6f210b6c84a60fe43cafcd: 2023-02-16 17:01:37,267 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,267 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:37,267 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1/906bc1a749d14342b90880c0a55de542] hfiles 2023-02-16 17:01:37,267 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1/906bc1a749d14342b90880c0a55de542 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,267 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2/da1eee2429ab4f179a0d44904a1ec07c] hfiles 2023-02-16 17:01:37,267 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2/da1eee2429ab4f179a0d44904a1ec07c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,275 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2/9f170425c46345a49350eec31a105e2f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:37,276 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4062b4e8a179ed2266a585a9327bed5b in 166ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:37,276 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4062b4e8a179ed2266a585a9327bed5b: 2023-02-16 17:01:37,276 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,276 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:37,276 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1/e0909d7aeb5449108f61076acb02c2e0] hfiles 2023-02-16 17:01:37,276 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1/e0909d7aeb5449108f61076acb02c2e0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,276 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2/9f170425c46345a49350eec31a105e2f] hfiles 2023-02-16 17:01:37,276 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2/9f170425c46345a49350eec31a105e2f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,279 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. completed. 2023-02-16 17:01:37,279 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:37,279 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:37,279 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 17:01:37,279 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. started... 2023-02-16 17:01:37,281 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 21f6114bd03361dc1260ae06183b3b7d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:37,281 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2/8aaad5806f374b4ebaedc1b179de79e8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:37,282 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8ecbd25752d0ce070f9f1e2abbd51042 in 139ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:37,282 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8ecbd25752d0ce070f9f1e2abbd51042: 2023-02-16 17:01:37,282 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,282 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:37,282 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1/bbeb55e767584d549860cfef265a0aa8] hfiles 2023-02-16 17:01:37,282 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1/bbeb55e767584d549860cfef265a0aa8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,282 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2/8aaad5806f374b4ebaedc1b179de79e8] hfiles 2023-02-16 17:01:37,282 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2/8aaad5806f374b4ebaedc1b179de79e8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,289 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. completed. 2023-02-16 17:01:37,289 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:37,289 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 17:01:37,292 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. completed. 2023-02-16 17:01:37,292 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:37,292 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 17:01:37,304 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. completed. 2023-02-16 17:01:37,304 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:37,304 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:37,304 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-16 17:01:37,304 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. completed. 2023-02-16 17:01:37,304 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:37,304 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. started... 2023-02-16 17:01:37,304 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-16 17:01:37,305 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7f1ae5a78fb89be58531d6f9228fa7c1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-16 17:01:37,307 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/.tmp/f1/1b390fb576e747189d971924c0daa5b3 2023-02-16 17:01:37,322 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/.tmp/f1/b4b57a0287d54f58b4a3b9305a25f201 2023-02-16 17:01:37,328 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/.tmp/f2/0dbc00db2e5d4a9c9e5b7a77f67fae2e 2023-02-16 17:01:37,333 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/.tmp/f1/1b390fb576e747189d971924c0daa5b3 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1/1b390fb576e747189d971924c0daa5b3 2023-02-16 17:01:37,338 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1/1b390fb576e747189d971924c0daa5b3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:37,339 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/.tmp/f2/0dbc00db2e5d4a9c9e5b7a77f67fae2e as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2/0dbc00db2e5d4a9c9e5b7a77f67fae2e 2023-02-16 17:01:37,342 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/.tmp/f2/ac9627465fcc448ea65462b156d3302e 2023-02-16 17:01:37,343 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2/0dbc00db2e5d4a9c9e5b7a77f67fae2e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:37,344 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 21f6114bd03361dc1260ae06183b3b7d in 63ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:37,344 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 21f6114bd03361dc1260ae06183b3b7d: 2023-02-16 17:01:37,345 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,345 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:37,345 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1/1b390fb576e747189d971924c0daa5b3] hfiles 2023-02-16 17:01:37,345 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1/1b390fb576e747189d971924c0daa5b3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,345 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2/0dbc00db2e5d4a9c9e5b7a77f67fae2e] hfiles 2023-02-16 17:01:37,345 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2/0dbc00db2e5d4a9c9e5b7a77f67fae2e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,346 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/.tmp/f1/b4b57a0287d54f58b4a3b9305a25f201 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1/b4b57a0287d54f58b4a3b9305a25f201 2023-02-16 17:01:37,351 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1/b4b57a0287d54f58b4a3b9305a25f201, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:37,351 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. completed. 2023-02-16 17:01:37,351 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:37,351 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 17:01:37,351 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 17:01:37,351 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,351 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 17:01:37,351 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,46079,1676566894264' in zk 2023-02-16 17:01:37,351 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/.tmp/f2/ac9627465fcc448ea65462b156d3302e as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2/ac9627465fcc448ea65462b156d3302e 2023-02-16 17:01:37,355 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2/ac9627465fcc448ea65462b156d3302e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-16 17:01:37,356 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7f1ae5a78fb89be58531d6f9228fa7c1 in 51ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:37,356 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7f1ae5a78fb89be58531d6f9228fa7c1: 2023-02-16 17:01:37,356 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,356 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:37,356 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1/b4b57a0287d54f58b4a3b9305a25f201] hfiles 2023-02-16 17:01:37,356 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1/b4b57a0287d54f58b4a3b9305a25f201 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,356 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2/ac9627465fcc448ea65462b156d3302e] hfiles 2023-02-16 17:01:37,356 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2/ac9627465fcc448ea65462b156d3302e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,361 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. completed. 2023-02-16 17:01:37,361 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:37,361 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-16 17:01:37,444 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 17:01:37,445 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,445 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:37,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:37,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:37,445 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 17:01:37,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:37,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:37,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:37,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,46079,1676566894264': 2023-02-16 17:01:37,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46079,1676566894264' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 17:01:37,468 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:37,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 17:01:37,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:37,469 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-16 17:01:37,724 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. completed. 2023-02-16 17:01:37,724 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-16 17:01:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-16 17:01:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 17:01:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,37679,1676566894287' in zk 2023-02-16 17:01:37,814 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 17:01:37,814 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,814 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:37,814 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 17:01:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,37679,1676566894287': 2023-02-16 17:01:37,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37679,1676566894287' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 17:01:37,817 INFO [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-16 17:01:37,817 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:37,817 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:37,817 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,817 INFO [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 17:01:37,906 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,906 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,906 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:37,906 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:37,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,906 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:37,907 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:37,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:37,907 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,909 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,909 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:37,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:37,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:37,969 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:37,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 17:01:37,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:37,971 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-16 17:01:38,067 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:38,067 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:38,067 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:38,067 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:38,067 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-16 17:01:38,067 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:38,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:38,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:38,067 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:38,067 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:38,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:38,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-16 17:01:38,068 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:38,068 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:38,068 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:38,068 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:38,068 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:38,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:38,068 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:38,068 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:38,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:38,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:38,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:38,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:38,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-16 17:01:38,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:38,127 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:38,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676566896862Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676566898067 (+1205 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676566898068 (+1 ms)Writing data manifest for testWithMockedMapReduceMultiRegion at 1676566898077 (+9 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676566898096 (+19 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676566898126 (+30 ms) 2023-02-16 17:01:38,128 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-16 17:01:38,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 1.2650 sec 2023-02-16 17:01:38,971 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:38,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-16 17:01:38,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 17:01:38,972 INFO [Listener at localhost/35457] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 17:01:38,976 INFO [Listener at localhost/35457] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 17:01:38,983 INFO [Listener at localhost/35457] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 17:01:39,013 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46079] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:39,014 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37679] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:39,071 INFO [Listener at localhost/35457] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 17:01:39,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 17:01:39,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,081 INFO [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-16 17:01:39,081 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:39,082 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-16 17:01:39,082 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-16 17:01:39,083 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,083 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,098 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:39,098 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:39,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:39,098 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:39,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,099 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,099 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,099 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,100 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:39,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,100 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,100 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,100 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-16 17:01:39,100 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:39,101 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,102 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 17:01:39,102 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-16 17:01:39,102 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:39,102 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-16 17:01:39,103 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 17:01:39,103 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. started... 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:39,103 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4062b4e8a179ed2266a585a9327bed5b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:39,103 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-16 17:01:39,103 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. started... 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. started... 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:39,103 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2398758f270e0596d064983c250c0d15 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. started... 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. started... 2023-02-16 17:01:39,103 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d15bd7abda6f210b6c84a60fe43cafcd 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. started... 2023-02-16 17:01:39,103 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 20f3096d8125f78221b2488c69302ee2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b09ea274eee145a71c64e3229d5055da: 2023-02-16 17:01:39,104 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:39,104 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:39,104 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. started... 2023-02-16 17:01:39,104 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 36df7543091f382b63ddb591c9cdf546 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-16 17:01:39,103 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for afa10271d99d82ea3d3e2e277659c6a7: 2023-02-16 17:01:39,105 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:39,105 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:39,105 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. started... 2023-02-16 17:01:39,106 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8ecbd25752d0ce070f9f1e2abbd51042 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:39,106 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 17:01:39,104 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-16 17:01:39,155 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/.tmp/f1/c2b11697c985455588d3b3492d7a88de 2023-02-16 17:01:39,156 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/.tmp/f1/bf31ddee00434a6dae1e7c60d7a8e0b2 2023-02-16 17:01:39,157 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/.tmp/f1/1561c76d106643b0a8c8c807154b4189 2023-02-16 17:01:39,160 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/.tmp/f1/1f1fc070bfff40c5aea6a0cc7858b5de 2023-02-16 17:01:39,161 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/.tmp/f1/922893416bdc4fdaa860323dd5936ce0 2023-02-16 17:01:39,183 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/.tmp/f2/01ba603ca6354b258483bc4bd4a152fa 2023-02-16 17:01:39,191 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/.tmp/f1/1561c76d106643b0a8c8c807154b4189 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1/1561c76d106643b0a8c8c807154b4189 2023-02-16 17:01:39,196 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/.tmp/f2/f54158eedd3b46139e51c66302ac4e97 2023-02-16 17:01:39,200 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/.tmp/f1/1f1fc070bfff40c5aea6a0cc7858b5de as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1/1f1fc070bfff40c5aea6a0cc7858b5de 2023-02-16 17:01:39,204 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1/1f1fc070bfff40c5aea6a0cc7858b5de, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 17:01:39,205 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1/1561c76d106643b0a8c8c807154b4189, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:39,205 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/.tmp/f2/f54158eedd3b46139e51c66302ac4e97 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2/f54158eedd3b46139e51c66302ac4e97 2023-02-16 17:01:39,205 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/.tmp/f2/01ba603ca6354b258483bc4bd4a152fa as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2/01ba603ca6354b258483bc4bd4a152fa 2023-02-16 17:01:39,209 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2/01ba603ca6354b258483bc4bd4a152fa, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:39,210 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2/f54158eedd3b46139e51c66302ac4e97, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 17:01:39,210 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 20f3096d8125f78221b2488c69302ee2 in 107ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:39,210 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 20f3096d8125f78221b2488c69302ee2: 2023-02-16 17:01:39,210 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:39,210 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:39,210 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 17:01:39,210 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 36df7543091f382b63ddb591c9cdf546 in 106ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:39,210 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. started... 2023-02-16 17:01:39,210 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 36df7543091f382b63ddb591c9cdf546: 2023-02-16 17:01:39,211 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 21f6114bd03361dc1260ae06183b3b7d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:39,211 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 17:01:39,222 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/.tmp/f2/b98477b7b98f424082abe88fb6f80fbc 2023-02-16 17:01:39,222 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/.tmp/f2/2aaa20f549b3483484a565336ea7b083 2023-02-16 17:01:39,223 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/.tmp/f2/89a716d24e56428893f3ca2c4c0a3068 2023-02-16 17:01:39,227 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/.tmp/f1/922893416bdc4fdaa860323dd5936ce0 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1/922893416bdc4fdaa860323dd5936ce0 2023-02-16 17:01:39,227 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/.tmp/f1/c2b11697c985455588d3b3492d7a88de as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1/c2b11697c985455588d3b3492d7a88de 2023-02-16 17:01:39,228 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/.tmp/f1/bf31ddee00434a6dae1e7c60d7a8e0b2 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1/bf31ddee00434a6dae1e7c60d7a8e0b2 2023-02-16 17:01:39,233 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1/922893416bdc4fdaa860323dd5936ce0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:39,234 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1/c2b11697c985455588d3b3492d7a88de, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:39,234 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/.tmp/f2/2aaa20f549b3483484a565336ea7b083 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2/2aaa20f549b3483484a565336ea7b083 2023-02-16 17:01:39,234 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1/bf31ddee00434a6dae1e7c60d7a8e0b2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:39,235 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/.tmp/f2/b98477b7b98f424082abe88fb6f80fbc as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2/b98477b7b98f424082abe88fb6f80fbc 2023-02-16 17:01:39,235 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/.tmp/f2/89a716d24e56428893f3ca2c4c0a3068 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2/89a716d24e56428893f3ca2c4c0a3068 2023-02-16 17:01:39,239 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/.tmp/f1/9cc3173cf4194f88b2c704d6e57ed27d 2023-02-16 17:01:39,239 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2/2aaa20f549b3483484a565336ea7b083, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:39,240 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2/b98477b7b98f424082abe88fb6f80fbc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:39,241 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8ecbd25752d0ce070f9f1e2abbd51042 in 135ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:39,241 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2/89a716d24e56428893f3ca2c4c0a3068, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:39,241 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8ecbd25752d0ce070f9f1e2abbd51042: 2023-02-16 17:01:39,241 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d15bd7abda6f210b6c84a60fe43cafcd in 138ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:39,241 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d15bd7abda6f210b6c84a60fe43cafcd: 2023-02-16 17:01:39,241 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:39,241 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:39,241 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. started... 2023-02-16 17:01:39,241 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:39,241 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7f1ae5a78fb89be58531d6f9228fa7c1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-16 17:01:39,241 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-16 17:01:39,241 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-16 17:01:39,242 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4062b4e8a179ed2266a585a9327bed5b in 139ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:39,243 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4062b4e8a179ed2266a585a9327bed5b: 2023-02-16 17:01:39,243 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:39,243 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 17:01:39,252 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/.tmp/f1/f7a1a6eaa1eb4717b18062c6a9e86e1e 2023-02-16 17:01:39,254 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/.tmp/f2/49618413cf354e53ad8ca160ea9de947 2023-02-16 17:01:39,258 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/.tmp/f1/9cc3173cf4194f88b2c704d6e57ed27d as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1/9cc3173cf4194f88b2c704d6e57ed27d 2023-02-16 17:01:39,262 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1/9cc3173cf4194f88b2c704d6e57ed27d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:39,263 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/.tmp/f2/49618413cf354e53ad8ca160ea9de947 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2/49618413cf354e53ad8ca160ea9de947 2023-02-16 17:01:39,263 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/.tmp/f2/b81a84b2d1f04627a86ae35246de6320 2023-02-16 17:01:39,267 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2/49618413cf354e53ad8ca160ea9de947, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:39,268 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/.tmp/f1/f7a1a6eaa1eb4717b18062c6a9e86e1e as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1/f7a1a6eaa1eb4717b18062c6a9e86e1e 2023-02-16 17:01:39,268 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 21f6114bd03361dc1260ae06183b3b7d in 57ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:39,268 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 21f6114bd03361dc1260ae06183b3b7d: 2023-02-16 17:01:39,268 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:39,268 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-16 17:01:39,271 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1/f7a1a6eaa1eb4717b18062c6a9e86e1e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:39,272 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/.tmp/f2/b81a84b2d1f04627a86ae35246de6320 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2/b81a84b2d1f04627a86ae35246de6320 2023-02-16 17:01:39,276 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2/b81a84b2d1f04627a86ae35246de6320, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-16 17:01:39,277 INFO [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7f1ae5a78fb89be58531d6f9228fa7c1 in 36ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:39,277 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7f1ae5a78fb89be58531d6f9228fa7c1: 2023-02-16 17:01:39,277 DEBUG [rs(jenkins-hbase4.apache.org,37679,1676566894287)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:39,278 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 17:01:39,278 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 17:01:39,278 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,278 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 17:01:39,278 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37679,1676566894287' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 17:01:39,279 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,279 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:39,280 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,280 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:39,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37679,1676566894287' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 17:01:39,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bf52557[Count = 1] remaining members to acquire global barrier 2023-02-16 17:01:39,551 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/.tmp/f1/859be7ffb8d54eb192ee3073958b42fc 2023-02-16 17:01:39,563 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/.tmp/f2/970722214a7444f5ae9280b30fe0e5b5 2023-02-16 17:01:39,567 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/.tmp/f1/859be7ffb8d54eb192ee3073958b42fc as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1/859be7ffb8d54eb192ee3073958b42fc 2023-02-16 17:01:39,571 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1/859be7ffb8d54eb192ee3073958b42fc, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 17:01:39,571 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/.tmp/f2/970722214a7444f5ae9280b30fe0e5b5 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2/970722214a7444f5ae9280b30fe0e5b5 2023-02-16 17:01:39,575 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2/970722214a7444f5ae9280b30fe0e5b5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-16 17:01:39,576 INFO [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 2398758f270e0596d064983c250c0d15 in 473ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:39,576 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2398758f270e0596d064983c250c0d15: 2023-02-16 17:01:39,576 DEBUG [rs(jenkins-hbase4.apache.org,46079,1676566894264)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-16 17:01:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-16 17:01:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-16 17:01:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46079,1676566894264' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-16 17:01:39,578 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:39,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46079,1676566894264' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-16 17:01:39,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bf52557[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:39,580 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-16 17:01:39,580 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,581 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,581 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,581 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 17:01:39,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,581 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 17:01:39,581 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-16 17:01:39,581 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-16 17:01:39,581 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,581 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,46079,1676566894264' in zk 2023-02-16 17:01:39,581 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,37679,1676566894287' in zk 2023-02-16 17:01:39,582 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,582 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:39,589 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,589 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 17:01:39,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:39,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:39,589 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:39,589 DEBUG [member: 'jenkins-hbase4.apache.org,46079,1676566894264' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 17:01:39,589 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:39,589 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-16 17:01:39,590 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:39,590 DEBUG [member: 'jenkins-hbase4.apache.org,37679,1676566894287' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-16 17:01:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:39,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,46079,1676566894264': 2023-02-16 17:01:39,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46079,1676566894264' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-16 17:01:39,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:39,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:39,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:39,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:39,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:39,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,37679,1676566894287': 2023-02-16 17:01:39,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37679,1676566894287' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-16 17:01:39,594 INFO [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-16 17:01:39,594 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:39,594 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:39,594 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,594 INFO [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 17:01:39,596 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,596 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:39,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:39,596 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,596 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:39,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,596 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:39,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:39,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,596 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:39,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:39,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:39,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:39,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,597 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:39,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,598 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:39,599 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,601 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,601 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,601 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:39,601 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:39,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:39,601 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,601 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:39,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-16 17:01:39,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 17:01:39,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:39,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:39,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:39,601 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:39,601 DEBUG [(jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:39,601 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,602 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:39,602 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,602 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:39,602 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:39,602 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:39,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:39,602 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 17:01:39,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:39,602 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:39,702 DEBUG [Listener at localhost/35457] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 17:01:39,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 17:01:39,709 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676566896745 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:39,709 DEBUG [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,709 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(239): region to add: d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:39,709 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(239): region to add: 2398758f270e0596d064983c250c0d15 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(239): region to add: afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(239): region to add: b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(239): region to add: 4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(239): region to add: 8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(239): region to add: 20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(239): region to add: 7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(239): region to add: 36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(239): region to add: 21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(585): clone region=d15bd7abda6f210b6c84a60fe43cafcd as d15bd7abda6f210b6c84a60fe43cafcd in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(585): clone region=2398758f270e0596d064983c250c0d15 as 2398758f270e0596d064983c250c0d15 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(585): clone region=afa10271d99d82ea3d3e2e277659c6a7 as afa10271d99d82ea3d3e2e277659c6a7 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(585): clone region=b09ea274eee145a71c64e3229d5055da as b09ea274eee145a71c64e3229d5055da in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(585): clone region=4062b4e8a179ed2266a585a9327bed5b as 4062b4e8a179ed2266a585a9327bed5b in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(585): clone region=8ecbd25752d0ce070f9f1e2abbd51042 as 8ecbd25752d0ce070f9f1e2abbd51042 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,710 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(585): clone region=20f3096d8125f78221b2488c69302ee2 as 20f3096d8125f78221b2488c69302ee2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,711 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(585): clone region=7f1ae5a78fb89be58531d6f9228fa7c1 as 7f1ae5a78fb89be58531d6f9228fa7c1 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,711 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(585): clone region=36df7543091f382b63ddb591c9cdf546 as 36df7543091f382b63ddb591c9cdf546 in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,711 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(585): clone region=21f6114bd03361dc1260ae06183b3b7d as 21f6114bd03361dc1260ae06183b3b7d in snapshot testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,712 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2398758f270e0596d064983c250c0d15, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0 2023-02-16 17:01:39,712 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d15bd7abda6f210b6c84a60fe43cafcd, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0 2023-02-16 17:01:39,712 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => b09ea274eee145a71c64e3229d5055da, NAME => 'testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0 2023-02-16 17:01:39,712 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => afa10271d99d82ea3d3e2e277659c6a7, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0 2023-02-16 17:01:39,717 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 20f3096d8125f78221b2488c69302ee2, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0 2023-02-16 17:01:39,717 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 7f1ae5a78fb89be58531d6f9228fa7c1, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0 2023-02-16 17:01:39,717 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 4062b4e8a179ed2266a585a9327bed5b, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0 2023-02-16 17:01:39,717 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 8ecbd25752d0ce070f9f1e2abbd51042, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0 2023-02-16 17:01:39,741 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:39,741 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:39,741 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 46c526f55f9244f29ab116bbe12e8698 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,741 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 906bc1a749d14342b90880c0a55de542 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,752 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink da1eee2429ab4f179a0d44904a1ec07c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,752 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink da7f3cf9b1e24b509bec089c93ae9b67 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,756 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:39,756 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bbeb55e767584d549860cfef265a0aa8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,756 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:39,756 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing afa10271d99d82ea3d3e2e277659c6a7, disabling compactions & flushes 2023-02-16 17:01:39,756 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:39,756 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:39,756 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. after waiting 0 ms 2023-02-16 17:01:39,756 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:39,756 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:39,756 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for afa10271d99d82ea3d3e2e277659c6a7: 2023-02-16 17:01:39,757 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 36df7543091f382b63ddb591c9cdf546, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0 2023-02-16 17:01:39,760 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:39,760 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 06abc8e2a27f489696ec5970c74c3061 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,764 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d15bd7abda6f210b6c84a60fe43cafcd, disabling compactions & flushes 2023-02-16 17:01:39,764 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:39,764 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:39,764 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. after waiting 0 ms 2023-02-16 17:01:39,764 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:39,764 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:39,764 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:39,764 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b4b57a0287d54f58b4a3b9305a25f201 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,764 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d15bd7abda6f210b6c84a60fe43cafcd: 2023-02-16 17:01:39,765 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 21f6114bd03361dc1260ae06183b3b7d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0 2023-02-16 17:01:39,766 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8aaad5806f374b4ebaedc1b179de79e8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,766 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:39,766 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing b09ea274eee145a71c64e3229d5055da, disabling compactions & flushes 2023-02-16 17:01:39,766 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:39,766 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:39,766 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. after waiting 0 ms 2023-02-16 17:01:39,766 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:39,766 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:39,766 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for b09ea274eee145a71c64e3229d5055da: 2023-02-16 17:01:39,771 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 8ecbd25752d0ce070f9f1e2abbd51042, disabling compactions & flushes 2023-02-16 17:01:39,771 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ac9627465fcc448ea65462b156d3302e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,771 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 269eca8f847448a2b1fa9b585b1b04f9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,771 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:39,771 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:39,772 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 547dd8c427054793812891ef6f859ead from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,772 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:39,772 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. after waiting 0 ms 2023-02-16 17:01:39,772 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:39,772 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:39,772 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 8ecbd25752d0ce070f9f1e2abbd51042: 2023-02-16 17:01:39,774 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b682ab39e8964a6e8340665d6c821f62 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,774 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 7f1ae5a78fb89be58531d6f9228fa7c1, disabling compactions & flushes 2023-02-16 17:01:39,774 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:39,774 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:39,774 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. after waiting 0 ms 2023-02-16 17:01:39,774 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:39,774 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:39,774 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 7f1ae5a78fb89be58531d6f9228fa7c1: 2023-02-16 17:01:39,774 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 20f3096d8125f78221b2488c69302ee2, disabling compactions & flushes 2023-02-16 17:01:39,775 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:39,775 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:39,775 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. after waiting 0 ms 2023-02-16 17:01:39,775 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:39,775 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:39,775 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 20f3096d8125f78221b2488c69302ee2: 2023-02-16 17:01:39,776 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:39,776 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1b390fb576e747189d971924c0daa5b3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,776 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 36df7543091f382b63ddb591c9cdf546, disabling compactions & flushes 2023-02-16 17:01:39,776 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:39,776 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:39,776 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. after waiting 0 ms 2023-02-16 17:01:39,776 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:39,776 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:39,776 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 36df7543091f382b63ddb591c9cdf546: 2023-02-16 17:01:39,778 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0dbc00db2e5d4a9c9e5b7a77f67fae2e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:39,780 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 21f6114bd03361dc1260ae06183b3b7d, disabling compactions & flushes 2023-02-16 17:01:39,780 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:39,780 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:39,780 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. after waiting 0 ms 2023-02-16 17:01:39,780 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:39,780 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:39,780 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 2398758f270e0596d064983c250c0d15, disabling compactions & flushes 2023-02-16 17:01:39,780 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 21f6114bd03361dc1260ae06183b3b7d: 2023-02-16 17:01:39,780 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:39,780 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:39,780 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. after waiting 0 ms 2023-02-16 17:01:39,780 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:39,780 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:39,780 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 2398758f270e0596d064983c250c0d15: 2023-02-16 17:01:40,155 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:40,156 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e0909d7aeb5449108f61076acb02c2e0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:40,160 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9f170425c46345a49350eec31a105e2f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:40,162 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 4062b4e8a179ed2266a585a9327bed5b, disabling compactions & flushes 2023-02-16 17:01:40,162 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:40,162 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:40,162 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. after waiting 0 ms 2023-02-16 17:01:40,162 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:40,162 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:40,162 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 4062b4e8a179ed2266a585a9327bed5b: 2023-02-16 17:01:40,162 INFO [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676566896745 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:40,163 DEBUG [Listener at localhost/35457] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0 2023-02-16 17:01:40,163 DEBUG [Listener at localhost/35457] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0 2023-02-16 17:01:40,164 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-data/ 2023-02-16 17:01:40,168 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |----default/ 2023-02-16 17:01:40,168 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-16 17:01:40,169 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |----------20f3096d8125f78221b2488c69302ee2/ 2023-02-16 17:01:40,169 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:40,169 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:40,170 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=20f3096d8125f78221b2488c69302ee2-06abc8e2a27f489696ec5970c74c3061 2023-02-16 17:01:40,170 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:40,170 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=20f3096d8125f78221b2488c69302ee2-269eca8f847448a2b1fa9b585b1b04f9 2023-02-16 17:01:40,170 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |----------21f6114bd03361dc1260ae06183b3b7d/ 2023-02-16 17:01:40,171 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:40,171 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:40,171 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=21f6114bd03361dc1260ae06183b3b7d-1b390fb576e747189d971924c0daa5b3 2023-02-16 17:01:40,171 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:40,171 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=21f6114bd03361dc1260ae06183b3b7d-0dbc00db2e5d4a9c9e5b7a77f67fae2e 2023-02-16 17:01:40,172 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |----------2398758f270e0596d064983c250c0d15/ 2023-02-16 17:01:40,172 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:40,172 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:40,172 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2398758f270e0596d064983c250c0d15-46c526f55f9244f29ab116bbe12e8698 2023-02-16 17:01:40,172 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:40,173 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2398758f270e0596d064983c250c0d15-da7f3cf9b1e24b509bec089c93ae9b67 2023-02-16 17:01:40,173 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |----------36df7543091f382b63ddb591c9cdf546/ 2023-02-16 17:01:40,173 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:40,173 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:40,174 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=36df7543091f382b63ddb591c9cdf546-547dd8c427054793812891ef6f859ead 2023-02-16 17:01:40,174 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:40,174 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=36df7543091f382b63ddb591c9cdf546-b682ab39e8964a6e8340665d6c821f62 2023-02-16 17:01:40,174 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |----------4062b4e8a179ed2266a585a9327bed5b/ 2023-02-16 17:01:40,174 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:40,174 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:40,175 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4062b4e8a179ed2266a585a9327bed5b-e0909d7aeb5449108f61076acb02c2e0 2023-02-16 17:01:40,175 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:40,175 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4062b4e8a179ed2266a585a9327bed5b-9f170425c46345a49350eec31a105e2f 2023-02-16 17:01:40,175 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |----------7f1ae5a78fb89be58531d6f9228fa7c1/ 2023-02-16 17:01:40,176 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:40,176 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:40,176 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7f1ae5a78fb89be58531d6f9228fa7c1-b4b57a0287d54f58b4a3b9305a25f201 2023-02-16 17:01:40,176 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:40,176 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=7f1ae5a78fb89be58531d6f9228fa7c1-ac9627465fcc448ea65462b156d3302e 2023-02-16 17:01:40,177 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |----------8ecbd25752d0ce070f9f1e2abbd51042/ 2023-02-16 17:01:40,177 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:40,177 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:40,177 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8ecbd25752d0ce070f9f1e2abbd51042-bbeb55e767584d549860cfef265a0aa8 2023-02-16 17:01:40,177 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:40,178 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8ecbd25752d0ce070f9f1e2abbd51042-8aaad5806f374b4ebaedc1b179de79e8 2023-02-16 17:01:40,178 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |----------afa10271d99d82ea3d3e2e277659c6a7/ 2023-02-16 17:01:40,178 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:40,178 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |----------b09ea274eee145a71c64e3229d5055da/ 2023-02-16 17:01:40,179 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:40,179 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |----------d15bd7abda6f210b6c84a60fe43cafcd/ 2023-02-16 17:01:40,179 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:40,179 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:40,179 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d15bd7abda6f210b6c84a60fe43cafcd-906bc1a749d14342b90880c0a55de542 2023-02-16 17:01:40,179 DEBUG [Listener at localhost/35457] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:40,180 DEBUG [Listener at localhost/35457] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d15bd7abda6f210b6c84a60fe43cafcd-da1eee2429ab4f179a0d44904a1ec07c 2023-02-16 17:01:40,183 INFO [Listener at localhost/35457] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 17:01:40,734 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 17:01:40,896 DEBUG [Listener at localhost/35457] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:40,896 INFO [Listener at localhost/35457] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:40,897 DEBUG [Listener at localhost/35457] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:40,899 INFO [StoreOpener-2398758f270e0596d064983c250c0d15-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2398758f270e0596d064983c250c0d15 2023-02-16 17:01:40,900 DEBUG [StoreOpener-2398758f270e0596d064983c250c0d15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1 2023-02-16 17:01:40,901 INFO [StoreOpener-2398758f270e0596d064983c250c0d15-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2398758f270e0596d064983c250c0d15 columnFamilyName f1 2023-02-16 17:01:40,904 DEBUG [StoreOpener-2398758f270e0596d064983c250c0d15-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1/testWithMockedMapReduceMultiRegion=2398758f270e0596d064983c250c0d15-46c526f55f9244f29ab116bbe12e8698 2023-02-16 17:01:40,905 INFO [StoreOpener-2398758f270e0596d064983c250c0d15-1] regionserver.HStore(310): Store=2398758f270e0596d064983c250c0d15/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:40,905 INFO [StoreOpener-2398758f270e0596d064983c250c0d15-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2398758f270e0596d064983c250c0d15 2023-02-16 17:01:40,905 DEBUG [StoreOpener-2398758f270e0596d064983c250c0d15-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2 2023-02-16 17:01:40,906 INFO [StoreOpener-2398758f270e0596d064983c250c0d15-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2398758f270e0596d064983c250c0d15 columnFamilyName f2 2023-02-16 17:01:40,909 DEBUG [StoreOpener-2398758f270e0596d064983c250c0d15-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2/testWithMockedMapReduceMultiRegion=2398758f270e0596d064983c250c0d15-da7f3cf9b1e24b509bec089c93ae9b67 2023-02-16 17:01:40,909 INFO [StoreOpener-2398758f270e0596d064983c250c0d15-1] regionserver.HStore(310): Store=2398758f270e0596d064983c250c0d15/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:40,909 DEBUG [Listener at localhost/35457] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:40,910 INFO [Listener at localhost/35457] regionserver.HRegion(1071): Opened 2398758f270e0596d064983c250c0d15; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63483555, jitterRate=-0.05402131378650665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:40,910 DEBUG [Listener at localhost/35457] regionserver.HRegion(964): Region open journal for 2398758f270e0596d064983c250c0d15: 2023-02-16 17:01:40,921 DEBUG [Listener at localhost/35457] regionserver.HRegion(1603): Closing 2398758f270e0596d064983c250c0d15, disabling compactions & flushes 2023-02-16 17:01:40,921 INFO [Listener at localhost/35457] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:40,921 DEBUG [Listener at localhost/35457] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:40,921 DEBUG [Listener at localhost/35457] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. after waiting 0 ms 2023-02-16 17:01:40,921 DEBUG [Listener at localhost/35457] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:40,922 INFO [Listener at localhost/35457] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:40,922 DEBUG [Listener at localhost/35457] regionserver.HRegion(1557): Region close journal for 2398758f270e0596d064983c250c0d15: 2023-02-16 17:01:40,922 DEBUG [Listener at localhost/35457] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:40,923 INFO [Listener at localhost/35457] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:40,924 DEBUG [Listener at localhost/35457] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:40,927 INFO [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:40,928 DEBUG [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1 2023-02-16 17:01:40,929 INFO [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20f3096d8125f78221b2488c69302ee2 columnFamilyName f1 2023-02-16 17:01:40,933 DEBUG [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1/testWithMockedMapReduceMultiRegion=20f3096d8125f78221b2488c69302ee2-06abc8e2a27f489696ec5970c74c3061 2023-02-16 17:01:40,933 INFO [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] regionserver.HStore(310): Store=20f3096d8125f78221b2488c69302ee2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:40,933 INFO [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:40,934 DEBUG [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2 2023-02-16 17:01:40,935 INFO [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20f3096d8125f78221b2488c69302ee2 columnFamilyName f2 2023-02-16 17:01:40,974 DEBUG [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2/testWithMockedMapReduceMultiRegion=20f3096d8125f78221b2488c69302ee2-269eca8f847448a2b1fa9b585b1b04f9 2023-02-16 17:01:40,975 INFO [StoreOpener-20f3096d8125f78221b2488c69302ee2-1] regionserver.HStore(310): Store=20f3096d8125f78221b2488c69302ee2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:40,975 DEBUG [Listener at localhost/35457] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:40,975 INFO [Listener at localhost/35457] regionserver.HRegion(1071): Opened 20f3096d8125f78221b2488c69302ee2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64873150, jitterRate=-0.03331473469734192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:40,975 DEBUG [Listener at localhost/35457] regionserver.HRegion(964): Region open journal for 20f3096d8125f78221b2488c69302ee2: 2023-02-16 17:01:40,985 DEBUG [Listener at localhost/35457] regionserver.HRegion(1603): Closing 20f3096d8125f78221b2488c69302ee2, disabling compactions & flushes 2023-02-16 17:01:40,986 INFO [Listener at localhost/35457] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:40,986 DEBUG [Listener at localhost/35457] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:40,986 DEBUG [Listener at localhost/35457] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. after waiting 0 ms 2023-02-16 17:01:40,986 DEBUG [Listener at localhost/35457] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:40,987 INFO [Listener at localhost/35457] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:40,987 DEBUG [Listener at localhost/35457] regionserver.HRegion(1557): Region close journal for 20f3096d8125f78221b2488c69302ee2: 2023-02-16 17:01:40,988 DEBUG [Listener at localhost/35457] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:40,988 INFO [Listener at localhost/35457] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:40,990 DEBUG [Listener at localhost/35457] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:40,992 INFO [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:40,993 DEBUG [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1 2023-02-16 17:01:40,993 INFO [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4062b4e8a179ed2266a585a9327bed5b columnFamilyName f1 2023-02-16 17:01:40,999 DEBUG [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1/testWithMockedMapReduceMultiRegion=4062b4e8a179ed2266a585a9327bed5b-e0909d7aeb5449108f61076acb02c2e0 2023-02-16 17:01:40,999 INFO [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] regionserver.HStore(310): Store=4062b4e8a179ed2266a585a9327bed5b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:40,999 INFO [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:41,000 DEBUG [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2 2023-02-16 17:01:41,000 INFO [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4062b4e8a179ed2266a585a9327bed5b columnFamilyName f2 2023-02-16 17:01:41,005 DEBUG [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2/testWithMockedMapReduceMultiRegion=4062b4e8a179ed2266a585a9327bed5b-9f170425c46345a49350eec31a105e2f 2023-02-16 17:01:41,005 INFO [StoreOpener-4062b4e8a179ed2266a585a9327bed5b-1] regionserver.HStore(310): Store=4062b4e8a179ed2266a585a9327bed5b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,006 DEBUG [Listener at localhost/35457] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:41,006 INFO [Listener at localhost/35457] regionserver.HRegion(1071): Opened 4062b4e8a179ed2266a585a9327bed5b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59038324, jitterRate=-0.12026041746139526}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:41,006 DEBUG [Listener at localhost/35457] regionserver.HRegion(964): Region open journal for 4062b4e8a179ed2266a585a9327bed5b: 2023-02-16 17:01:41,016 DEBUG [Listener at localhost/35457] regionserver.HRegion(1603): Closing 4062b4e8a179ed2266a585a9327bed5b, disabling compactions & flushes 2023-02-16 17:01:41,016 INFO [Listener at localhost/35457] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:41,016 DEBUG [Listener at localhost/35457] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:41,016 DEBUG [Listener at localhost/35457] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. after waiting 0 ms 2023-02-16 17:01:41,016 DEBUG [Listener at localhost/35457] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:41,017 INFO [Listener at localhost/35457] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:41,017 DEBUG [Listener at localhost/35457] regionserver.HRegion(1557): Region close journal for 4062b4e8a179ed2266a585a9327bed5b: 2023-02-16 17:01:41,018 DEBUG [Listener at localhost/35457] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:41,018 INFO [Listener at localhost/35457] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:41,024 DEBUG [Listener at localhost/35457] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:41,026 INFO [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:41,027 DEBUG [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1 2023-02-16 17:01:41,027 INFO [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36df7543091f382b63ddb591c9cdf546 columnFamilyName f1 2023-02-16 17:01:41,033 DEBUG [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1/testWithMockedMapReduceMultiRegion=36df7543091f382b63ddb591c9cdf546-547dd8c427054793812891ef6f859ead 2023-02-16 17:01:41,033 INFO [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] regionserver.HStore(310): Store=36df7543091f382b63ddb591c9cdf546/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,033 INFO [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:41,034 DEBUG [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2 2023-02-16 17:01:41,034 INFO [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36df7543091f382b63ddb591c9cdf546 columnFamilyName f2 2023-02-16 17:01:41,038 DEBUG [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2/testWithMockedMapReduceMultiRegion=36df7543091f382b63ddb591c9cdf546-b682ab39e8964a6e8340665d6c821f62 2023-02-16 17:01:41,038 INFO [StoreOpener-36df7543091f382b63ddb591c9cdf546-1] regionserver.HStore(310): Store=36df7543091f382b63ddb591c9cdf546/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,038 DEBUG [Listener at localhost/35457] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:41,038 INFO [Listener at localhost/35457] regionserver.HRegion(1071): Opened 36df7543091f382b63ddb591c9cdf546; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71317552, jitterRate=0.0627143383026123}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:41,038 DEBUG [Listener at localhost/35457] regionserver.HRegion(964): Region open journal for 36df7543091f382b63ddb591c9cdf546: 2023-02-16 17:01:41,048 DEBUG [Listener at localhost/35457] regionserver.HRegion(1603): Closing 36df7543091f382b63ddb591c9cdf546, disabling compactions & flushes 2023-02-16 17:01:41,048 INFO [Listener at localhost/35457] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:41,048 DEBUG [Listener at localhost/35457] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:41,048 DEBUG [Listener at localhost/35457] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. after waiting 0 ms 2023-02-16 17:01:41,048 DEBUG [Listener at localhost/35457] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:41,049 INFO [Listener at localhost/35457] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:41,049 DEBUG [Listener at localhost/35457] regionserver.HRegion(1557): Region close journal for 36df7543091f382b63ddb591c9cdf546: 2023-02-16 17:01:41,050 DEBUG [Listener at localhost/35457] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:41,050 INFO [Listener at localhost/35457] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:41,056 DEBUG [Listener at localhost/35457] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:41,060 INFO [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:41,061 DEBUG [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/f1 2023-02-16 17:01:41,062 INFO [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afa10271d99d82ea3d3e2e277659c6a7 columnFamilyName f1 2023-02-16 17:01:41,062 INFO [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] regionserver.HStore(310): Store=afa10271d99d82ea3d3e2e277659c6a7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,063 INFO [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:41,064 DEBUG [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/f2 2023-02-16 17:01:41,064 INFO [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afa10271d99d82ea3d3e2e277659c6a7 columnFamilyName f2 2023-02-16 17:01:41,064 INFO [StoreOpener-afa10271d99d82ea3d3e2e277659c6a7-1] regionserver.HStore(310): Store=afa10271d99d82ea3d3e2e277659c6a7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,065 DEBUG [Listener at localhost/35457] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:41,065 INFO [Listener at localhost/35457] regionserver.HRegion(1071): Opened afa10271d99d82ea3d3e2e277659c6a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59776117, jitterRate=-0.10926644504070282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:41,065 DEBUG [Listener at localhost/35457] regionserver.HRegion(964): Region open journal for afa10271d99d82ea3d3e2e277659c6a7: 2023-02-16 17:01:41,065 DEBUG [Listener at localhost/35457] regionserver.HRegion(1603): Closing afa10271d99d82ea3d3e2e277659c6a7, disabling compactions & flushes 2023-02-16 17:01:41,065 INFO [Listener at localhost/35457] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:41,065 DEBUG [Listener at localhost/35457] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:41,065 DEBUG [Listener at localhost/35457] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. after waiting 0 ms 2023-02-16 17:01:41,065 DEBUG [Listener at localhost/35457] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:41,066 INFO [Listener at localhost/35457] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:41,066 DEBUG [Listener at localhost/35457] regionserver.HRegion(1557): Region close journal for afa10271d99d82ea3d3e2e277659c6a7: 2023-02-16 17:01:41,067 DEBUG [Listener at localhost/35457] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:41,067 INFO [Listener at localhost/35457] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:41,069 DEBUG [Listener at localhost/35457] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:41,071 INFO [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:41,072 DEBUG [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1 2023-02-16 17:01:41,072 INFO [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ecbd25752d0ce070f9f1e2abbd51042 columnFamilyName f1 2023-02-16 17:01:41,076 DEBUG [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1/testWithMockedMapReduceMultiRegion=8ecbd25752d0ce070f9f1e2abbd51042-bbeb55e767584d549860cfef265a0aa8 2023-02-16 17:01:41,076 INFO [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] regionserver.HStore(310): Store=8ecbd25752d0ce070f9f1e2abbd51042/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,077 INFO [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:41,077 DEBUG [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2 2023-02-16 17:01:41,078 INFO [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ecbd25752d0ce070f9f1e2abbd51042 columnFamilyName f2 2023-02-16 17:01:41,082 DEBUG [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2/testWithMockedMapReduceMultiRegion=8ecbd25752d0ce070f9f1e2abbd51042-8aaad5806f374b4ebaedc1b179de79e8 2023-02-16 17:01:41,082 INFO [StoreOpener-8ecbd25752d0ce070f9f1e2abbd51042-1] regionserver.HStore(310): Store=8ecbd25752d0ce070f9f1e2abbd51042/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,082 DEBUG [Listener at localhost/35457] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:41,082 INFO [Listener at localhost/35457] regionserver.HRegion(1071): Opened 8ecbd25752d0ce070f9f1e2abbd51042; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68330321, jitterRate=0.018201127648353577}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:41,082 DEBUG [Listener at localhost/35457] regionserver.HRegion(964): Region open journal for 8ecbd25752d0ce070f9f1e2abbd51042: 2023-02-16 17:01:41,091 DEBUG [Listener at localhost/35457] regionserver.HRegion(1603): Closing 8ecbd25752d0ce070f9f1e2abbd51042, disabling compactions & flushes 2023-02-16 17:01:41,091 INFO [Listener at localhost/35457] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:41,091 DEBUG [Listener at localhost/35457] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:41,091 DEBUG [Listener at localhost/35457] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. after waiting 0 ms 2023-02-16 17:01:41,091 DEBUG [Listener at localhost/35457] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:41,092 INFO [Listener at localhost/35457] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:41,092 DEBUG [Listener at localhost/35457] regionserver.HRegion(1557): Region close journal for 8ecbd25752d0ce070f9f1e2abbd51042: 2023-02-16 17:01:41,093 DEBUG [Listener at localhost/35457] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:41,093 INFO [Listener at localhost/35457] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:41,094 DEBUG [Listener at localhost/35457] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:41,096 INFO [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:41,097 DEBUG [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1 2023-02-16 17:01:41,097 INFO [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21f6114bd03361dc1260ae06183b3b7d columnFamilyName f1 2023-02-16 17:01:41,102 DEBUG [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1/testWithMockedMapReduceMultiRegion=21f6114bd03361dc1260ae06183b3b7d-1b390fb576e747189d971924c0daa5b3 2023-02-16 17:01:41,102 INFO [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] regionserver.HStore(310): Store=21f6114bd03361dc1260ae06183b3b7d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,102 INFO [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:41,103 DEBUG [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2 2023-02-16 17:01:41,103 INFO [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21f6114bd03361dc1260ae06183b3b7d columnFamilyName f2 2023-02-16 17:01:41,109 DEBUG [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2/testWithMockedMapReduceMultiRegion=21f6114bd03361dc1260ae06183b3b7d-0dbc00db2e5d4a9c9e5b7a77f67fae2e 2023-02-16 17:01:41,109 INFO [StoreOpener-21f6114bd03361dc1260ae06183b3b7d-1] regionserver.HStore(310): Store=21f6114bd03361dc1260ae06183b3b7d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,109 DEBUG [Listener at localhost/35457] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:41,110 INFO [Listener at localhost/35457] regionserver.HRegion(1071): Opened 21f6114bd03361dc1260ae06183b3b7d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59629546, jitterRate=-0.11145052313804626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:41,110 DEBUG [Listener at localhost/35457] regionserver.HRegion(964): Region open journal for 21f6114bd03361dc1260ae06183b3b7d: 2023-02-16 17:01:41,118 DEBUG [Listener at localhost/35457] regionserver.HRegion(1603): Closing 21f6114bd03361dc1260ae06183b3b7d, disabling compactions & flushes 2023-02-16 17:01:41,118 INFO [Listener at localhost/35457] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:41,118 DEBUG [Listener at localhost/35457] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:41,118 DEBUG [Listener at localhost/35457] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. after waiting 0 ms 2023-02-16 17:01:41,118 DEBUG [Listener at localhost/35457] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:41,119 INFO [Listener at localhost/35457] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:41,119 DEBUG [Listener at localhost/35457] regionserver.HRegion(1557): Region close journal for 21f6114bd03361dc1260ae06183b3b7d: 2023-02-16 17:01:41,120 DEBUG [Listener at localhost/35457] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:41,120 INFO [Listener at localhost/35457] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:41,123 DEBUG [Listener at localhost/35457] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:41,124 INFO [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:41,126 DEBUG [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/f1 2023-02-16 17:01:41,126 INFO [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b09ea274eee145a71c64e3229d5055da columnFamilyName f1 2023-02-16 17:01:41,128 INFO [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] regionserver.HStore(310): Store=b09ea274eee145a71c64e3229d5055da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,128 INFO [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:41,129 DEBUG [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/f2 2023-02-16 17:01:41,130 INFO [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b09ea274eee145a71c64e3229d5055da columnFamilyName f2 2023-02-16 17:01:41,131 INFO [StoreOpener-b09ea274eee145a71c64e3229d5055da-1] regionserver.HStore(310): Store=b09ea274eee145a71c64e3229d5055da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,131 DEBUG [Listener at localhost/35457] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:41,131 INFO [Listener at localhost/35457] regionserver.HRegion(1071): Opened b09ea274eee145a71c64e3229d5055da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72027281, jitterRate=0.07329012453556061}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:41,131 DEBUG [Listener at localhost/35457] regionserver.HRegion(964): Region open journal for b09ea274eee145a71c64e3229d5055da: 2023-02-16 17:01:41,131 DEBUG [Listener at localhost/35457] regionserver.HRegion(1603): Closing b09ea274eee145a71c64e3229d5055da, disabling compactions & flushes 2023-02-16 17:01:41,132 INFO [Listener at localhost/35457] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:41,132 DEBUG [Listener at localhost/35457] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:41,132 DEBUG [Listener at localhost/35457] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. after waiting 0 ms 2023-02-16 17:01:41,132 DEBUG [Listener at localhost/35457] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:41,132 INFO [Listener at localhost/35457] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:41,132 DEBUG [Listener at localhost/35457] regionserver.HRegion(1557): Region close journal for b09ea274eee145a71c64e3229d5055da: 2023-02-16 17:01:41,133 DEBUG [Listener at localhost/35457] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:41,133 INFO [Listener at localhost/35457] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:41,135 DEBUG [Listener at localhost/35457] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:41,137 INFO [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:41,138 DEBUG [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1 2023-02-16 17:01:41,138 INFO [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d15bd7abda6f210b6c84a60fe43cafcd columnFamilyName f1 2023-02-16 17:01:41,144 DEBUG [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1/testWithMockedMapReduceMultiRegion=d15bd7abda6f210b6c84a60fe43cafcd-906bc1a749d14342b90880c0a55de542 2023-02-16 17:01:41,144 INFO [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] regionserver.HStore(310): Store=d15bd7abda6f210b6c84a60fe43cafcd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,145 INFO [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:41,146 DEBUG [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2 2023-02-16 17:01:41,146 INFO [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d15bd7abda6f210b6c84a60fe43cafcd columnFamilyName f2 2023-02-16 17:01:41,150 DEBUG [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2/testWithMockedMapReduceMultiRegion=d15bd7abda6f210b6c84a60fe43cafcd-da1eee2429ab4f179a0d44904a1ec07c 2023-02-16 17:01:41,150 INFO [StoreOpener-d15bd7abda6f210b6c84a60fe43cafcd-1] regionserver.HStore(310): Store=d15bd7abda6f210b6c84a60fe43cafcd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,150 DEBUG [Listener at localhost/35457] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:41,150 INFO [Listener at localhost/35457] regionserver.HRegion(1071): Opened d15bd7abda6f210b6c84a60fe43cafcd; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60841861, jitterRate=-0.09338562190532684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:41,150 DEBUG [Listener at localhost/35457] regionserver.HRegion(964): Region open journal for d15bd7abda6f210b6c84a60fe43cafcd: 2023-02-16 17:01:41,160 DEBUG [Listener at localhost/35457] regionserver.HRegion(1603): Closing d15bd7abda6f210b6c84a60fe43cafcd, disabling compactions & flushes 2023-02-16 17:01:41,161 INFO [Listener at localhost/35457] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:41,161 DEBUG [Listener at localhost/35457] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:41,161 DEBUG [Listener at localhost/35457] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. after waiting 0 ms 2023-02-16 17:01:41,161 DEBUG [Listener at localhost/35457] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:41,162 INFO [Listener at localhost/35457] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:41,162 DEBUG [Listener at localhost/35457] regionserver.HRegion(1557): Region close journal for d15bd7abda6f210b6c84a60fe43cafcd: 2023-02-16 17:01:41,163 DEBUG [Listener at localhost/35457] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:41,163 INFO [Listener at localhost/35457] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:41,164 DEBUG [Listener at localhost/35457] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:41,166 INFO [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:41,167 DEBUG [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1 2023-02-16 17:01:41,167 INFO [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f1ae5a78fb89be58531d6f9228fa7c1 columnFamilyName f1 2023-02-16 17:01:41,172 DEBUG [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1/testWithMockedMapReduceMultiRegion=7f1ae5a78fb89be58531d6f9228fa7c1-b4b57a0287d54f58b4a3b9305a25f201 2023-02-16 17:01:41,172 INFO [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] regionserver.HStore(310): Store=7f1ae5a78fb89be58531d6f9228fa7c1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,172 INFO [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:41,173 DEBUG [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2 2023-02-16 17:01:41,173 INFO [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f1ae5a78fb89be58531d6f9228fa7c1 columnFamilyName f2 2023-02-16 17:01:41,178 DEBUG [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] regionserver.HStore(539): loaded hdfs://localhost:40231/user/jenkins/test-data/fa391e68-f2f3-b12f-b569-6f960db32eed/testWithMockedMapReduceMultiRegion/6caeae01-3ae2-4a9e-b0a2-54af4bd93ed0/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2/testWithMockedMapReduceMultiRegion=7f1ae5a78fb89be58531d6f9228fa7c1-ac9627465fcc448ea65462b156d3302e 2023-02-16 17:01:41,178 INFO [StoreOpener-7f1ae5a78fb89be58531d6f9228fa7c1-1] regionserver.HStore(310): Store=7f1ae5a78fb89be58531d6f9228fa7c1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:41,178 DEBUG [Listener at localhost/35457] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:41,178 INFO [Listener at localhost/35457] regionserver.HRegion(1071): Opened 7f1ae5a78fb89be58531d6f9228fa7c1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64419791, jitterRate=-0.0400703102350235}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:41,178 DEBUG [Listener at localhost/35457] regionserver.HRegion(964): Region open journal for 7f1ae5a78fb89be58531d6f9228fa7c1: 2023-02-16 17:01:41,187 DEBUG [Listener at localhost/35457] regionserver.HRegion(1603): Closing 7f1ae5a78fb89be58531d6f9228fa7c1, disabling compactions & flushes 2023-02-16 17:01:41,187 INFO [Listener at localhost/35457] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:41,187 DEBUG [Listener at localhost/35457] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:41,187 DEBUG [Listener at localhost/35457] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. after waiting 0 ms 2023-02-16 17:01:41,187 DEBUG [Listener at localhost/35457] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:41,188 INFO [Listener at localhost/35457] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:41,188 DEBUG [Listener at localhost/35457] regionserver.HRegion(1557): Region close journal for 7f1ae5a78fb89be58531d6f9228fa7c1: 2023-02-16 17:01:41,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-16 17:01:41,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-16 17:01:41,197 INFO [Listener at localhost/35457] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-16 17:01:41,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-16 17:01:41,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:41,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 17:01:41,202 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566901202"}]},"ts":"1676566901202"} 2023-02-16 17:01:41,203 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-16 17:01:41,205 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-16 17:01:41,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b09ea274eee145a71c64e3229d5055da, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2398758f270e0596d064983c250c0d15, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4062b4e8a179ed2266a585a9327bed5b, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ecbd25752d0ce070f9f1e2abbd51042, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20f3096d8125f78221b2488c69302ee2, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f1ae5a78fb89be58531d6f9228fa7c1, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d15bd7abda6f210b6c84a60fe43cafcd, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21f6114bd03361dc1260ae06183b3b7d, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36df7543091f382b63ddb591c9cdf546, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afa10271d99d82ea3d3e2e277659c6a7, UNASSIGN}] 2023-02-16 17:01:41,208 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20f3096d8125f78221b2488c69302ee2, UNASSIGN 2023-02-16 17:01:41,208 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2398758f270e0596d064983c250c0d15, UNASSIGN 2023-02-16 17:01:41,208 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ecbd25752d0ce070f9f1e2abbd51042, UNASSIGN 2023-02-16 17:01:41,208 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4062b4e8a179ed2266a585a9327bed5b, UNASSIGN 2023-02-16 17:01:41,208 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afa10271d99d82ea3d3e2e277659c6a7, UNASSIGN 2023-02-16 17:01:41,209 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=20f3096d8125f78221b2488c69302ee2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:41,209 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=2398758f270e0596d064983c250c0d15, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:41,209 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566901209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566901209"}]},"ts":"1676566901209"} 2023-02-16 17:01:41,209 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566901209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566901209"}]},"ts":"1676566901209"} 2023-02-16 17:01:41,209 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8ecbd25752d0ce070f9f1e2abbd51042, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:41,209 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4062b4e8a179ed2266a585a9327bed5b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:41,209 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566901209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566901209"}]},"ts":"1676566901209"} 2023-02-16 17:01:41,209 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566901209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566901209"}]},"ts":"1676566901209"} 2023-02-16 17:01:41,210 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=afa10271d99d82ea3d3e2e277659c6a7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:41,210 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676566901210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566901210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566901210"}]},"ts":"1676566901210"} 2023-02-16 17:01:41,211 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=38, state=RUNNABLE; CloseRegionProcedure 20f3096d8125f78221b2488c69302ee2, server=jenkins-hbase4.apache.org,46079,1676566894264}] 2023-02-16 17:01:41,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=35, state=RUNNABLE; CloseRegionProcedure 2398758f270e0596d064983c250c0d15, server=jenkins-hbase4.apache.org,46079,1676566894264}] 2023-02-16 17:01:41,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure 8ecbd25752d0ce070f9f1e2abbd51042, server=jenkins-hbase4.apache.org,37679,1676566894287}] 2023-02-16 17:01:41,213 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=36, state=RUNNABLE; CloseRegionProcedure 4062b4e8a179ed2266a585a9327bed5b, server=jenkins-hbase4.apache.org,37679,1676566894287}] 2023-02-16 17:01:41,213 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36df7543091f382b63ddb591c9cdf546, UNASSIGN 2023-02-16 17:01:41,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure afa10271d99d82ea3d3e2e277659c6a7, server=jenkins-hbase4.apache.org,37679,1676566894287}] 2023-02-16 17:01:41,214 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=36df7543091f382b63ddb591c9cdf546, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:41,214 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901214"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566901214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566901214"}]},"ts":"1676566901214"} 2023-02-16 17:01:41,215 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21f6114bd03361dc1260ae06183b3b7d, UNASSIGN 2023-02-16 17:01:41,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 36df7543091f382b63ddb591c9cdf546, server=jenkins-hbase4.apache.org,46079,1676566894264}] 2023-02-16 17:01:41,216 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d15bd7abda6f210b6c84a60fe43cafcd, UNASSIGN 2023-02-16 17:01:41,217 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=21f6114bd03361dc1260ae06183b3b7d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:41,217 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d15bd7abda6f210b6c84a60fe43cafcd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:41,217 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901217"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566901217"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566901217"}]},"ts":"1676566901217"} 2023-02-16 17:01:41,217 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f1ae5a78fb89be58531d6f9228fa7c1, UNASSIGN 2023-02-16 17:01:41,217 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901217"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566901217"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566901217"}]},"ts":"1676566901217"} 2023-02-16 17:01:41,218 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b09ea274eee145a71c64e3229d5055da, UNASSIGN 2023-02-16 17:01:41,218 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=7f1ae5a78fb89be58531d6f9228fa7c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:41,218 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901218"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566901218"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566901218"}]},"ts":"1676566901218"} 2023-02-16 17:01:41,219 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=b09ea274eee145a71c64e3229d5055da, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:41,219 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676566901219"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566901219"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566901219"}]},"ts":"1676566901219"} 2023-02-16 17:01:41,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 21f6114bd03361dc1260ae06183b3b7d, server=jenkins-hbase4.apache.org,46079,1676566894264}] 2023-02-16 17:01:41,221 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure d15bd7abda6f210b6c84a60fe43cafcd, server=jenkins-hbase4.apache.org,37679,1676566894287}] 2023-02-16 17:01:41,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 7f1ae5a78fb89be58531d6f9228fa7c1, server=jenkins-hbase4.apache.org,37679,1676566894287}] 2023-02-16 17:01:41,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure b09ea274eee145a71c64e3229d5055da, server=jenkins-hbase4.apache.org,46079,1676566894264}] 2023-02-16 17:01:41,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 17:01:41,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:41,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 21f6114bd03361dc1260ae06183b3b7d, disabling compactions & flushes 2023-02-16 17:01:41,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:41,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:41,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. after waiting 0 ms 2023-02-16 17:01:41,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:41,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:41,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8ecbd25752d0ce070f9f1e2abbd51042, disabling compactions & flushes 2023-02-16 17:01:41,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:41,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:41,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. after waiting 0 ms 2023-02-16 17:01:41,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:41,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:41,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d. 2023-02-16 17:01:41,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 21f6114bd03361dc1260ae06183b3b7d: 2023-02-16 17:01:41,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:41,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:41,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 36df7543091f382b63ddb591c9cdf546, disabling compactions & flushes 2023-02-16 17:01:41,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:41,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:41,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. after waiting 0 ms 2023-02-16 17:01:41,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:41,372 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=21f6114bd03361dc1260ae06183b3b7d, regionState=CLOSED 2023-02-16 17:01:41,372 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566901372"}]},"ts":"1676566901372"} 2023-02-16 17:01:41,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:41,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042. 2023-02-16 17:01:41,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8ecbd25752d0ce070f9f1e2abbd51042: 2023-02-16 17:01:41,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:41,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:41,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing afa10271d99d82ea3d3e2e277659c6a7, disabling compactions & flushes 2023-02-16 17:01:41,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:41,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:41,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. after waiting 0 ms 2023-02-16 17:01:41,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:41,377 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8ecbd25752d0ce070f9f1e2abbd51042, regionState=CLOSED 2023-02-16 17:01:41,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:41,377 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901377"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566901377"}]},"ts":"1676566901377"} 2023-02-16 17:01:41,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-16 17:01:41,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 21f6114bd03361dc1260ae06183b3b7d, server=jenkins-hbase4.apache.org,46079,1676566894264 in 155 msec 2023-02-16 17:01:41,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546. 2023-02-16 17:01:41,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 36df7543091f382b63ddb591c9cdf546: 2023-02-16 17:01:41,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 17:01:41,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7. 2023-02-16 17:01:41,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for afa10271d99d82ea3d3e2e277659c6a7: 2023-02-16 17:01:41,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:41,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:41,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 20f3096d8125f78221b2488c69302ee2, disabling compactions & flushes 2023-02-16 17:01:41,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:41,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:41,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. after waiting 0 ms 2023-02-16 17:01:41,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:41,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=21f6114bd03361dc1260ae06183b3b7d, UNASSIGN in 172 msec 2023-02-16 17:01:41,382 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=36df7543091f382b63ddb591c9cdf546, regionState=CLOSED 2023-02-16 17:01:41,382 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566901382"}]},"ts":"1676566901382"} 2023-02-16 17:01:41,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:41,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:41,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4062b4e8a179ed2266a585a9327bed5b, disabling compactions & flushes 2023-02-16 17:01:41,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:41,383 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-16 17:01:41,383 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure 8ecbd25752d0ce070f9f1e2abbd51042, server=jenkins-hbase4.apache.org,37679,1676566894287 in 167 msec 2023-02-16 17:01:41,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:41,383 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=afa10271d99d82ea3d3e2e277659c6a7, regionState=CLOSED 2023-02-16 17:01:41,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. after waiting 0 ms 2023-02-16 17:01:41,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:41,383 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676566901383"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566901383"}]},"ts":"1676566901383"} 2023-02-16 17:01:41,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ecbd25752d0ce070f9f1e2abbd51042, UNASSIGN in 177 msec 2023-02-16 17:01:41,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-16 17:01:41,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 36df7543091f382b63ddb591c9cdf546, server=jenkins-hbase4.apache.org,46079,1676566894264 in 168 msec 2023-02-16 17:01:41,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-16 17:01:41,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure afa10271d99d82ea3d3e2e277659c6a7, server=jenkins-hbase4.apache.org,37679,1676566894287 in 171 msec 2023-02-16 17:01:41,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36df7543091f382b63ddb591c9cdf546, UNASSIGN in 180 msec 2023-02-16 17:01:41,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:41,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=afa10271d99d82ea3d3e2e277659c6a7, UNASSIGN in 181 msec 2023-02-16 17:01:41,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2. 2023-02-16 17:01:41,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:41,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 20f3096d8125f78221b2488c69302ee2: 2023-02-16 17:01:41,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b. 2023-02-16 17:01:41,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4062b4e8a179ed2266a585a9327bed5b: 2023-02-16 17:01:41,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:41,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2398758f270e0596d064983c250c0d15 2023-02-16 17:01:41,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2398758f270e0596d064983c250c0d15, disabling compactions & flushes 2023-02-16 17:01:41,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:41,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:41,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. after waiting 0 ms 2023-02-16 17:01:41,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:41,392 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=20f3096d8125f78221b2488c69302ee2, regionState=CLOSED 2023-02-16 17:01:41,392 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901392"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566901392"}]},"ts":"1676566901392"} 2023-02-16 17:01:41,393 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4062b4e8a179ed2266a585a9327bed5b, regionState=CLOSED 2023-02-16 17:01:41,393 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566901393"}]},"ts":"1676566901393"} 2023-02-16 17:01:41,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:41,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:41,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d15bd7abda6f210b6c84a60fe43cafcd, disabling compactions & flushes 2023-02-16 17:01:41,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:41,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:41,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. after waiting 0 ms 2023-02-16 17:01:41,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:41,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=38 2023-02-16 17:01:41,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=38, state=SUCCESS; CloseRegionProcedure 20f3096d8125f78221b2488c69302ee2, server=jenkins-hbase4.apache.org,46079,1676566894264 in 183 msec 2023-02-16 17:01:41,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=36 2023-02-16 17:01:41,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=36, state=SUCCESS; CloseRegionProcedure 4062b4e8a179ed2266a585a9327bed5b, server=jenkins-hbase4.apache.org,37679,1676566894287 in 181 msec 2023-02-16 17:01:41,397 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=20f3096d8125f78221b2488c69302ee2, UNASSIGN in 190 msec 2023-02-16 17:01:41,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:41,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4062b4e8a179ed2266a585a9327bed5b, UNASSIGN in 191 msec 2023-02-16 17:01:41,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15. 2023-02-16 17:01:41,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2398758f270e0596d064983c250c0d15: 2023-02-16 17:01:41,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:41,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd. 2023-02-16 17:01:41,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d15bd7abda6f210b6c84a60fe43cafcd: 2023-02-16 17:01:41,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2398758f270e0596d064983c250c0d15 2023-02-16 17:01:41,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:41,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b09ea274eee145a71c64e3229d5055da, disabling compactions & flushes 2023-02-16 17:01:41,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:41,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:41,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. after waiting 0 ms 2023-02-16 17:01:41,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:41,409 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=2398758f270e0596d064983c250c0d15, regionState=CLOSED 2023-02-16 17:01:41,409 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901409"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566901409"}]},"ts":"1676566901409"} 2023-02-16 17:01:41,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:41,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:41,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7f1ae5a78fb89be58531d6f9228fa7c1, disabling compactions & flushes 2023-02-16 17:01:41,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:41,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:41,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. after waiting 0 ms 2023-02-16 17:01:41,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:41,410 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d15bd7abda6f210b6c84a60fe43cafcd, regionState=CLOSED 2023-02-16 17:01:41,410 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566901410"}]},"ts":"1676566901410"} 2023-02-16 17:01:41,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=35 2023-02-16 17:01:41,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=35, state=SUCCESS; CloseRegionProcedure 2398758f270e0596d064983c250c0d15, server=jenkins-hbase4.apache.org,46079,1676566894264 in 200 msec 2023-02-16 17:01:41,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-16 17:01:41,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-16 17:01:41,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure d15bd7abda6f210b6c84a60fe43cafcd, server=jenkins-hbase4.apache.org,37679,1676566894287 in 191 msec 2023-02-16 17:01:41,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da. 2023-02-16 17:01:41,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2398758f270e0596d064983c250c0d15, UNASSIGN in 207 msec 2023-02-16 17:01:41,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b09ea274eee145a71c64e3229d5055da: 2023-02-16 17:01:41,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d15bd7abda6f210b6c84a60fe43cafcd, UNASSIGN in 207 msec 2023-02-16 17:01:41,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:41,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:41,416 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=b09ea274eee145a71c64e3229d5055da, regionState=CLOSED 2023-02-16 17:01:41,416 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676566901416"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566901416"}]},"ts":"1676566901416"} 2023-02-16 17:01:41,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1. 2023-02-16 17:01:41,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7f1ae5a78fb89be58531d6f9228fa7c1: 2023-02-16 17:01:41,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:41,419 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=7f1ae5a78fb89be58531d6f9228fa7c1, regionState=CLOSED 2023-02-16 17:01:41,419 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676566901419"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566901419"}]},"ts":"1676566901419"} 2023-02-16 17:01:41,420 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-16 17:01:41,420 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure b09ea274eee145a71c64e3229d5055da, server=jenkins-hbase4.apache.org,46079,1676566894264 in 192 msec 2023-02-16 17:01:41,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b09ea274eee145a71c64e3229d5055da, UNASSIGN in 214 msec 2023-02-16 17:01:41,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-16 17:01:41,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 7f1ae5a78fb89be58531d6f9228fa7c1, server=jenkins-hbase4.apache.org,37679,1676566894287 in 198 msec 2023-02-16 17:01:41,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=33 2023-02-16 17:01:41,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7f1ae5a78fb89be58531d6f9228fa7c1, UNASSIGN in 216 msec 2023-02-16 17:01:41,424 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566901424"}]},"ts":"1676566901424"} 2023-02-16 17:01:41,425 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-16 17:01:41,426 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-16 17:01:41,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 229 msec 2023-02-16 17:01:41,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-16 17:01:41,505 INFO [Listener at localhost/35457] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-16 17:01:41,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-16 17:01:41,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:41,508 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:41,509 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:41,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 17:01:41,521 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:41,521 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:41,521 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:41,521 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:41,521 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:41,521 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:41,521 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:41,521 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15 2023-02-16 17:01:41,523 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/f1, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/f2, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/recovered.edits] 2023-02-16 17:01:41,524 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/recovered.edits] 2023-02-16 17:01:41,524 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/recovered.edits] 2023-02-16 17:01:41,525 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/recovered.edits] 2023-02-16 17:01:41,525 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/recovered.edits] 2023-02-16 17:01:41,525 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/recovered.edits] 2023-02-16 17:01:41,525 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/recovered.edits] 2023-02-16 17:01:41,526 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/recovered.edits] 2023-02-16 17:01:41,531 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1/bf31ddee00434a6dae1e7c60d7a8e0b2 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1/bf31ddee00434a6dae1e7c60d7a8e0b2 2023-02-16 17:01:41,531 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1/906bc1a749d14342b90880c0a55de542 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1/906bc1a749d14342b90880c0a55de542 2023-02-16 17:01:41,532 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1/46c526f55f9244f29ab116bbe12e8698 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1/46c526f55f9244f29ab116bbe12e8698 2023-02-16 17:01:41,533 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1/06abc8e2a27f489696ec5970c74c3061 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1/06abc8e2a27f489696ec5970c74c3061 2023-02-16 17:01:41,533 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1/1b390fb576e747189d971924c0daa5b3 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1/1b390fb576e747189d971924c0daa5b3 2023-02-16 17:01:41,534 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1/922893416bdc4fdaa860323dd5936ce0 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1/922893416bdc4fdaa860323dd5936ce0 2023-02-16 17:01:41,534 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/recovered.edits/6.seqid to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da/recovered.edits/6.seqid 2023-02-16 17:01:41,534 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1/e0909d7aeb5449108f61076acb02c2e0 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f1/e0909d7aeb5449108f61076acb02c2e0 2023-02-16 17:01:41,534 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1/c2b11697c985455588d3b3492d7a88de to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f1/c2b11697c985455588d3b3492d7a88de 2023-02-16 17:01:41,535 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1/b4b57a0287d54f58b4a3b9305a25f201 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1/b4b57a0287d54f58b4a3b9305a25f201 2023-02-16 17:01:41,535 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1/1561c76d106643b0a8c8c807154b4189 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f1/1561c76d106643b0a8c8c807154b4189 2023-02-16 17:01:41,535 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/b09ea274eee145a71c64e3229d5055da 2023-02-16 17:01:41,535 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:41,536 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1/bbeb55e767584d549860cfef265a0aa8 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f1/bbeb55e767584d549860cfef265a0aa8 2023-02-16 17:01:41,536 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1/859be7ffb8d54eb192ee3073958b42fc to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f1/859be7ffb8d54eb192ee3073958b42fc 2023-02-16 17:01:41,536 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1/9cc3173cf4194f88b2c704d6e57ed27d to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f1/9cc3173cf4194f88b2c704d6e57ed27d 2023-02-16 17:01:41,538 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1/f7a1a6eaa1eb4717b18062c6a9e86e1e to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f1/f7a1a6eaa1eb4717b18062c6a9e86e1e 2023-02-16 17:01:41,539 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/recovered.edits] 2023-02-16 17:01:41,541 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2/89a716d24e56428893f3ca2c4c0a3068 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2/89a716d24e56428893f3ca2c4c0a3068 2023-02-16 17:01:41,541 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2/970722214a7444f5ae9280b30fe0e5b5 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2/970722214a7444f5ae9280b30fe0e5b5 2023-02-16 17:01:41,541 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2/01ba603ca6354b258483bc4bd4a152fa to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2/01ba603ca6354b258483bc4bd4a152fa 2023-02-16 17:01:41,542 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2/0dbc00db2e5d4a9c9e5b7a77f67fae2e to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2/0dbc00db2e5d4a9c9e5b7a77f67fae2e 2023-02-16 17:01:41,542 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2/b98477b7b98f424082abe88fb6f80fbc to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2/b98477b7b98f424082abe88fb6f80fbc 2023-02-16 17:01:41,542 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2/2aaa20f549b3483484a565336ea7b083 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2/2aaa20f549b3483484a565336ea7b083 2023-02-16 17:01:41,543 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2/ac9627465fcc448ea65462b156d3302e to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2/ac9627465fcc448ea65462b156d3302e 2023-02-16 17:01:41,544 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2/49618413cf354e53ad8ca160ea9de947 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/f2/49618413cf354e53ad8ca160ea9de947 2023-02-16 17:01:41,544 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2/da1eee2429ab4f179a0d44904a1ec07c to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/f2/da1eee2429ab4f179a0d44904a1ec07c 2023-02-16 17:01:41,544 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2/269eca8f847448a2b1fa9b585b1b04f9 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/f2/269eca8f847448a2b1fa9b585b1b04f9 2023-02-16 17:01:41,547 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2/9f170425c46345a49350eec31a105e2f to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/f2/9f170425c46345a49350eec31a105e2f 2023-02-16 17:01:41,547 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2/da7f3cf9b1e24b509bec089c93ae9b67 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/f2/da7f3cf9b1e24b509bec089c93ae9b67 2023-02-16 17:01:41,547 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2/8aaad5806f374b4ebaedc1b179de79e8 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/f2/8aaad5806f374b4ebaedc1b179de79e8 2023-02-16 17:01:41,550 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2/b81a84b2d1f04627a86ae35246de6320 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/f2/b81a84b2d1f04627a86ae35246de6320 2023-02-16 17:01:41,550 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1/1f1fc070bfff40c5aea6a0cc7858b5de to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1/1f1fc070bfff40c5aea6a0cc7858b5de 2023-02-16 17:01:41,552 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1/547dd8c427054793812891ef6f859ead to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f1/547dd8c427054793812891ef6f859ead 2023-02-16 17:01:41,552 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/recovered.edits/12.seqid to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2/recovered.edits/12.seqid 2023-02-16 17:01:41,553 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/recovered.edits/12.seqid to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d/recovered.edits/12.seqid 2023-02-16 17:01:41,553 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/recovered.edits/12.seqid to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042/recovered.edits/12.seqid 2023-02-16 17:01:41,553 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/recovered.edits/12.seqid to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b/recovered.edits/12.seqid 2023-02-16 17:01:41,554 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/20f3096d8125f78221b2488c69302ee2 2023-02-16 17:01:41,554 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:41,554 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/21f6114bd03361dc1260ae06183b3b7d 2023-02-16 17:01:41,554 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/recovered.edits/12.seqid to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd/recovered.edits/12.seqid 2023-02-16 17:01:41,555 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/4062b4e8a179ed2266a585a9327bed5b 2023-02-16 17:01:41,555 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ecbd25752d0ce070f9f1e2abbd51042 2023-02-16 17:01:41,556 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/d15bd7abda6f210b6c84a60fe43cafcd 2023-02-16 17:01:41,556 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/recovered.edits/12.seqid to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1/recovered.edits/12.seqid 2023-02-16 17:01:41,556 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/recovered.edits/12.seqid to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15/recovered.edits/12.seqid 2023-02-16 17:01:41,558 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/7f1ae5a78fb89be58531d6f9228fa7c1 2023-02-16 17:01:41,558 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/2398758f270e0596d064983c250c0d15 2023-02-16 17:01:41,558 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/f1, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/f2, FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/recovered.edits] 2023-02-16 17:01:41,559 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2/b682ab39e8964a6e8340665d6c821f62 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2/b682ab39e8964a6e8340665d6c821f62 2023-02-16 17:01:41,561 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2/f54158eedd3b46139e51c66302ac4e97 to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/f2/f54158eedd3b46139e51c66302ac4e97 2023-02-16 17:01:41,563 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/recovered.edits/12.seqid to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546/recovered.edits/12.seqid 2023-02-16 17:01:41,564 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/recovered.edits/6.seqid to hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/archive/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7/recovered.edits/6.seqid 2023-02-16 17:01:41,564 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/36df7543091f382b63ddb591c9cdf546 2023-02-16 17:01:41,564 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/.tmp/data/default/testWithMockedMapReduceMultiRegion/afa10271d99d82ea3d3e2e277659c6a7 2023-02-16 17:01:41,564 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-16 17:01:41,566 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:41,569 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-16 17:01:41,572 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-16 17:01:41,572 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:41,572 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-16 17:01:41,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566901572"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:41,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566901572"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:41,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566901572"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:41,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566901572"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:41,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566901572"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:41,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566901572"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:41,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566901572"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:41,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566901572"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:41,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566901572"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:41,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566901572"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:41,574 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-16 17:01:41,575 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b09ea274eee145a71c64e3229d5055da, NAME => 'testWithMockedMapReduceMultiRegion,,1676566895517.b09ea274eee145a71c64e3229d5055da.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 2398758f270e0596d064983c250c0d15, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676566895517.2398758f270e0596d064983c250c0d15.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 4062b4e8a179ed2266a585a9327bed5b, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676566895517.4062b4e8a179ed2266a585a9327bed5b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 8ecbd25752d0ce070f9f1e2abbd51042, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676566895517.8ecbd25752d0ce070f9f1e2abbd51042.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 20f3096d8125f78221b2488c69302ee2, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676566895517.20f3096d8125f78221b2488c69302ee2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 7f1ae5a78fb89be58531d6f9228fa7c1, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676566895517.7f1ae5a78fb89be58531d6f9228fa7c1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => d15bd7abda6f210b6c84a60fe43cafcd, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676566895517.d15bd7abda6f210b6c84a60fe43cafcd.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 21f6114bd03361dc1260ae06183b3b7d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676566895517.21f6114bd03361dc1260ae06183b3b7d.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 36df7543091f382b63ddb591c9cdf546, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676566895517.36df7543091f382b63ddb591c9cdf546.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => afa10271d99d82ea3d3e2e277659c6a7, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676566895517.afa10271d99d82ea3d3e2e277659c6a7.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-16 17:01:41,575 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-16 17:01:41,575 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676566901575"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:41,576 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-16 17:01:41,578 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-16 17:01:41,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 74 msec 2023-02-16 17:01:41,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40979] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-16 17:01:41,611 INFO [Listener at localhost/35457] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-16 17:01:41,611 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 17:01:41,611 INFO [Listener at localhost/35457] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 17:01:41,611 DEBUG [Listener at localhost/35457] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76e7a3a3 to 127.0.0.1:58835 2023-02-16 17:01:41,611 DEBUG [Listener at localhost/35457] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:41,611 DEBUG [Listener at localhost/35457] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 17:01:41,611 DEBUG [Listener at localhost/35457] util.JVMClusterUtil(257): Found active master hash=1602763302, stopped=false 2023-02-16 17:01:41,611 INFO [Listener at localhost/35457] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40979,1676566894225 2023-02-16 17:01:41,613 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:41,613 INFO [Listener at localhost/35457] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 17:01:41,613 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:41,613 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:41,613 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:41,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:41,616 DEBUG [Listener at localhost/35457] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b596249 to 127.0.0.1:58835 2023-02-16 17:01:41,616 DEBUG [Listener at localhost/35457] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:41,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:41,616 INFO [Listener at localhost/35457] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46079,1676566894264' ***** 2023-02-16 17:01:41,616 INFO [Listener at localhost/35457] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:41,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:41,616 INFO [Listener at localhost/35457] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37679,1676566894287' ***** 2023-02-16 17:01:41,616 INFO [Listener at localhost/35457] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:41,616 INFO [RS:0;jenkins-hbase4:46079] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:41,617 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:41,617 INFO [RS:0;jenkins-hbase4:46079] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:41,618 INFO [RS:1;jenkins-hbase4:37679] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:41,618 INFO [RS:0;jenkins-hbase4:46079] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:41,618 INFO [RS:1;jenkins-hbase4:37679] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:41,618 INFO [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(3304): Received CLOSE for 338f9e7ea169ebafadd3bc65223e69db 2023-02-16 17:01:41,618 INFO [RS:1;jenkins-hbase4:37679] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:41,618 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:41,618 INFO [RS:1;jenkins-hbase4:37679] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:41,618 INFO [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:41,619 DEBUG [RS:1;jenkins-hbase4:37679] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6532970c to 127.0.0.1:58835 2023-02-16 17:01:41,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 338f9e7ea169ebafadd3bc65223e69db, disabling compactions & flushes 2023-02-16 17:01:41,619 DEBUG [RS:1;jenkins-hbase4:37679] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:41,620 INFO [RS:1;jenkins-hbase4:37679] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37679,1676566894287; all regions closed. 2023-02-16 17:01:41,619 DEBUG [RS:0;jenkins-hbase4:46079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d1adf27 to 127.0.0.1:58835 2023-02-16 17:01:41,620 DEBUG [RS:0;jenkins-hbase4:46079] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:41,620 INFO [RS:0;jenkins-hbase4:46079] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:41,620 INFO [RS:0;jenkins-hbase4:46079] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:41,620 INFO [RS:0;jenkins-hbase4:46079] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:41,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. 2023-02-16 17:01:41,620 INFO [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 17:01:41,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. 2023-02-16 17:01:41,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. after waiting 0 ms 2023-02-16 17:01:41,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. 2023-02-16 17:01:41,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 338f9e7ea169ebafadd3bc65223e69db 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 17:01:41,620 INFO [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 17:01:41,620 DEBUG [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(1479): Online Regions={338f9e7ea169ebafadd3bc65223e69db=hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db., 1588230740=hbase:meta,,1.1588230740} 2023-02-16 17:01:41,623 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:41,623 DEBUG [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(1505): Waiting on 1588230740, 338f9e7ea169ebafadd3bc65223e69db 2023-02-16 17:01:41,623 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:41,623 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:41,623 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:41,623 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:41,623 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-16 17:01:41,626 DEBUG [RS:1;jenkins-hbase4:37679] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/oldWALs 2023-02-16 17:01:41,626 INFO [RS:1;jenkins-hbase4:37679] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37679%2C1676566894287:(num 1676566895631) 2023-02-16 17:01:41,626 DEBUG [RS:1;jenkins-hbase4:37679] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:41,626 INFO [RS:1;jenkins-hbase4:37679] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:41,627 INFO [RS:1;jenkins-hbase4:37679] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:41,632 INFO [RS:1;jenkins-hbase4:37679] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:41,632 INFO [RS:1;jenkins-hbase4:37679] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:41,632 INFO [RS:1;jenkins-hbase4:37679] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:41,632 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:41,633 INFO [RS:1;jenkins-hbase4:37679] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37679 2023-02-16 17:01:41,636 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:41,636 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37679,1676566894287 2023-02-16 17:01:41,636 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:41,636 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:41,636 ERROR [Listener at localhost/35457-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@41f901eb rejected from java.util.concurrent.ThreadPoolExecutor@45c68d0c[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:41,637 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:41,637 ERROR [Listener at localhost/35457-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@38f100b2 rejected from java.util.concurrent.ThreadPoolExecutor@45c68d0c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:41,637 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37679,1676566894287] 2023-02-16 17:01:41,637 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37679,1676566894287; numProcessing=1 2023-02-16 17:01:41,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db/.tmp/info/2edaf807846e4446b56660cc7d2a3446 2023-02-16 17:01:41,640 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37679,1676566894287 already deleted, retry=false 2023-02-16 17:01:41,640 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37679,1676566894287 expired; onlineServers=1 2023-02-16 17:01:41,641 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/.tmp/info/79964fd2707b4cf0a8fc7b5283f01c69 2023-02-16 17:01:41,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db/.tmp/info/2edaf807846e4446b56660cc7d2a3446 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db/info/2edaf807846e4446b56660cc7d2a3446 2023-02-16 17:01:41,644 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79964fd2707b4cf0a8fc7b5283f01c69 2023-02-16 17:01:41,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db/info/2edaf807846e4446b56660cc7d2a3446, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 17:01:41,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 338f9e7ea169ebafadd3bc65223e69db in 28ms, sequenceid=6, compaction requested=false 2023-02-16 17:01:41,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/.tmp/rep_barrier/d40482174f8b4129905b0e330d6a09dd 2023-02-16 17:01:41,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/namespace/338f9e7ea169ebafadd3bc65223e69db/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 17:01:41,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. 2023-02-16 17:01:41,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 338f9e7ea169ebafadd3bc65223e69db: 2023-02-16 17:01:41,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676566894853.338f9e7ea169ebafadd3bc65223e69db. 2023-02-16 17:01:41,656 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d40482174f8b4129905b0e330d6a09dd 2023-02-16 17:01:41,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/.tmp/table/93cd3985afd748ea9e6271e5161a2d46 2023-02-16 17:01:41,667 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93cd3985afd748ea9e6271e5161a2d46 2023-02-16 17:01:41,668 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/.tmp/info/79964fd2707b4cf0a8fc7b5283f01c69 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/info/79964fd2707b4cf0a8fc7b5283f01c69 2023-02-16 17:01:41,671 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79964fd2707b4cf0a8fc7b5283f01c69 2023-02-16 17:01:41,671 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/info/79964fd2707b4cf0a8fc7b5283f01c69, entries=30, sequenceid=57, filesize=8.3 K 2023-02-16 17:01:41,671 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/.tmp/rep_barrier/d40482174f8b4129905b0e330d6a09dd as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/rep_barrier/d40482174f8b4129905b0e330d6a09dd 2023-02-16 17:01:41,674 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d40482174f8b4129905b0e330d6a09dd 2023-02-16 17:01:41,675 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/rep_barrier/d40482174f8b4129905b0e330d6a09dd, entries=10, sequenceid=57, filesize=6.1 K 2023-02-16 17:01:41,675 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/.tmp/table/93cd3985afd748ea9e6271e5161a2d46 as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/table/93cd3985afd748ea9e6271e5161a2d46 2023-02-16 17:01:41,678 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93cd3985afd748ea9e6271e5161a2d46 2023-02-16 17:01:41,678 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/table/93cd3985afd748ea9e6271e5161a2d46, entries=13, sequenceid=57, filesize=6.1 K 2023-02-16 17:01:41,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=57, compaction requested=false 2023-02-16 17:01:41,682 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-16 17:01:41,683 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 17:01:41,683 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:41,684 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:41,684 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:41,702 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:41,704 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:41,813 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:41,813 INFO [RS:1;jenkins-hbase4:37679] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37679,1676566894287; zookeeper connection closed. 2023-02-16 17:01:41,813 ERROR [Listener at localhost/35457-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4051fdce rejected from java.util.concurrent.ThreadPoolExecutor@45c68d0c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:41,813 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:37679-0x1005e1480420002, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:41,813 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7eaac10e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7eaac10e 2023-02-16 17:01:41,813 ERROR [Listener at localhost/35457-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50af8ca0 rejected from java.util.concurrent.ThreadPoolExecutor@45c68d0c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:41,823 INFO [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46079,1676566894264; all regions closed. 2023-02-16 17:01:41,827 DEBUG [RS:0;jenkins-hbase4:46079] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/oldWALs 2023-02-16 17:01:41,827 INFO [RS:0;jenkins-hbase4:46079] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46079%2C1676566894264.meta:.meta(num 1676566894800) 2023-02-16 17:01:41,830 DEBUG [RS:0;jenkins-hbase4:46079] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/oldWALs 2023-02-16 17:01:41,830 INFO [RS:0;jenkins-hbase4:46079] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46079%2C1676566894264:(num 1676566895208) 2023-02-16 17:01:41,830 DEBUG [RS:0;jenkins-hbase4:46079] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:41,830 INFO [RS:0;jenkins-hbase4:46079] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:41,830 INFO [RS:0;jenkins-hbase4:46079] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:41,830 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:41,831 INFO [RS:0;jenkins-hbase4:46079] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46079 2023-02-16 17:01:41,833 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46079,1676566894264 2023-02-16 17:01:41,833 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:41,833 ERROR [Listener at localhost/35457-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a0b3282 rejected from java.util.concurrent.ThreadPoolExecutor@6e34bb1b[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:41,834 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46079,1676566894264] 2023-02-16 17:01:41,834 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46079,1676566894264; numProcessing=2 2023-02-16 17:01:41,835 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46079,1676566894264 already deleted, retry=false 2023-02-16 17:01:41,835 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46079,1676566894264 expired; onlineServers=0 2023-02-16 17:01:41,835 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40979,1676566894225' ***** 2023-02-16 17:01:41,835 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 17:01:41,837 DEBUG [M:0;jenkins-hbase4:40979] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bb7a50f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:41,837 INFO [M:0;jenkins-hbase4:40979] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40979,1676566894225 2023-02-16 17:01:41,837 INFO [M:0;jenkins-hbase4:40979] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40979,1676566894225; all regions closed. 2023-02-16 17:01:41,837 DEBUG [M:0;jenkins-hbase4:40979] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:41,837 DEBUG [M:0;jenkins-hbase4:40979] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 17:01:41,837 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 17:01:41,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566894432] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566894432,5,FailOnTimeoutGroup] 2023-02-16 17:01:41,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566894436] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566894436,5,FailOnTimeoutGroup] 2023-02-16 17:01:41,837 DEBUG [M:0;jenkins-hbase4:40979] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 17:01:41,839 INFO [M:0;jenkins-hbase4:40979] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 17:01:41,839 INFO [M:0;jenkins-hbase4:40979] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 17:01:41,839 INFO [M:0;jenkins-hbase4:40979] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 17:01:41,839 DEBUG [M:0;jenkins-hbase4:40979] master.HMaster(1512): Stopping service threads 2023-02-16 17:01:41,839 INFO [M:0;jenkins-hbase4:40979] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 17:01:41,839 ERROR [M:0;jenkins-hbase4:40979] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 17:01:41,839 INFO [M:0;jenkins-hbase4:40979] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 17:01:41,839 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 17:01:41,841 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:41,841 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:41,841 DEBUG [M:0;jenkins-hbase4:40979] zookeeper.ZKUtil(398): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 17:01:41,841 WARN [M:0;jenkins-hbase4:40979] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 17:01:41,841 INFO [M:0;jenkins-hbase4:40979] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 17:01:41,841 INFO [M:0;jenkins-hbase4:40979] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 17:01:41,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:41,841 DEBUG [M:0;jenkins-hbase4:40979] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:41,842 INFO [M:0;jenkins-hbase4:40979] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:41,842 DEBUG [M:0;jenkins-hbase4:40979] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:41,842 DEBUG [M:0;jenkins-hbase4:40979] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:41,842 DEBUG [M:0;jenkins-hbase4:40979] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:41,842 INFO [M:0;jenkins-hbase4:40979] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.11 KB heapSize=200.04 KB 2023-02-16 17:01:41,850 INFO [M:0;jenkins-hbase4:40979] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.11 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7c3ac7c30bac440cb700996d06bfbcdb 2023-02-16 17:01:41,853 DEBUG [M:0;jenkins-hbase4:40979] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7c3ac7c30bac440cb700996d06bfbcdb as hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7c3ac7c30bac440cb700996d06bfbcdb 2023-02-16 17:01:41,856 INFO [M:0;jenkins-hbase4:40979] regionserver.HStore(1080): Added hdfs://localhost:40231/user/jenkins/test-data/4f782c80-6565-50d9-90d4-63e733e6150e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7c3ac7c30bac440cb700996d06bfbcdb, entries=53, sequenceid=357, filesize=10.7 K 2023-02-16 17:01:41,857 INFO [M:0;jenkins-hbase4:40979] regionserver.HRegion(2947): Finished flush of dataSize ~167.11 KB/171123, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=357, compaction requested=false 2023-02-16 17:01:41,858 INFO [M:0;jenkins-hbase4:40979] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:41,858 DEBUG [M:0;jenkins-hbase4:40979] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:41,860 INFO [M:0;jenkins-hbase4:40979] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 17:01:41,860 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:41,861 INFO [M:0;jenkins-hbase4:40979] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40979 2023-02-16 17:01:41,863 DEBUG [M:0;jenkins-hbase4:40979] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40979,1676566894225 already deleted, retry=false 2023-02-16 17:01:42,214 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:42,214 INFO [M:0;jenkins-hbase4:40979] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40979,1676566894225; zookeeper connection closed. 2023-02-16 17:01:42,214 ERROR [Listener at localhost/35457-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@755420eb rejected from java.util.concurrent.ThreadPoolExecutor@716baa99[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:42,215 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): master:40979-0x1005e1480420000, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:42,215 ERROR [Listener at localhost/35457-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5190393d rejected from java.util.concurrent.ThreadPoolExecutor@716baa99[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:42,288 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 17:01:42,314 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:42,314 INFO [RS:0;jenkins-hbase4:46079] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46079,1676566894264; zookeeper connection closed. 2023-02-16 17:01:42,314 ERROR [Listener at localhost/35457-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@29fbfa3c rejected from java.util.concurrent.ThreadPoolExecutor@6e34bb1b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:42,314 DEBUG [Listener at localhost/35457-EventThread] zookeeper.ZKWatcher(600): regionserver:46079-0x1005e1480420001, quorum=127.0.0.1:58835, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:42,314 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@60b0aacd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@60b0aacd 2023-02-16 17:01:42,314 ERROR [Listener at localhost/35457-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5170ce91 rejected from java.util.concurrent.ThreadPoolExecutor@6e34bb1b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:42,314 INFO [Listener at localhost/35457] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 17:01:42,315 WARN [Listener at localhost/35457] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:42,319 INFO [Listener at localhost/35457] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:42,425 WARN [BP-726532710-172.31.14.131-1676566893660 heartbeating to localhost/127.0.0.1:40231] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 17:01:42,428 WARN [BP-726532710-172.31.14.131-1676566893660 heartbeating to localhost/127.0.0.1:40231] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-726532710-172.31.14.131-1676566893660 (Datanode Uuid 92175bd5-fab4-413e-8018-c06ed2b9dcb5) service to localhost/127.0.0.1:40231 2023-02-16 17:01:42,429 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/cluster_bd2238dd-2102-d5e3-20bf-8c0574d66ce8/dfs/data/data3/current/BP-726532710-172.31.14.131-1676566893660] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:42,429 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/cluster_bd2238dd-2102-d5e3-20bf-8c0574d66ce8/dfs/data/data4/current/BP-726532710-172.31.14.131-1676566893660] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:42,431 WARN [Listener at localhost/35457] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:42,437 INFO [Listener at localhost/35457] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:42,539 WARN [BP-726532710-172.31.14.131-1676566893660 heartbeating to localhost/127.0.0.1:40231] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 17:01:42,540 WARN [BP-726532710-172.31.14.131-1676566893660 heartbeating to localhost/127.0.0.1:40231] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-726532710-172.31.14.131-1676566893660 (Datanode Uuid f9ff6654-be8d-44cb-a9a4-61d6b67d366f) service to localhost/127.0.0.1:40231 2023-02-16 17:01:42,540 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/cluster_bd2238dd-2102-d5e3-20bf-8c0574d66ce8/dfs/data/data1/current/BP-726532710-172.31.14.131-1676566893660] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:42,541 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/cluster_bd2238dd-2102-d5e3-20bf-8c0574d66ce8/dfs/data/data2/current/BP-726532710-172.31.14.131-1676566893660] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:42,549 INFO [Listener at localhost/35457] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:42,671 INFO [Listener at localhost/35457] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 17:01:42,709 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 17:01:42,723 INFO [Listener at localhost/35457] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=227 (was 178) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40231 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35457.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/35457.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35457 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:40231 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:40231 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40979,1676566894225)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35457.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/35457.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35457.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35457.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/35457.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:40231 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35457.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:40231 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/35457.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35457.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:40231 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:40231 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=633 (was 572) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=350 (was 339) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=1197 (was 1270) 2023-02-16 17:01:42,734 INFO [Listener at localhost/35457] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=227, OpenFileDescriptor=633, MaxFileDescriptor=60000, SystemLoadAverage=350, ProcessCount=170, AvailableMemoryMB=1197 2023-02-16 17:01:42,744 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/hadoop.log.dir so I do NOT create it in target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2 2023-02-16 17:01:42,744 WARN [Listener at localhost/35457] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 17:01:42,744 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/hadoop.tmp.dir so I do NOT create it in target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2 2023-02-16 17:01:42,744 WARN [Listener at localhost/35457] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2902c152-5b88-2863-83e1-ce879567963e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 17:01:42,744 DEBUG [Listener at localhost/35457] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2 2023-02-16 17:01:42,744 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 17:01:42,744 INFO [Listener at localhost/35457] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/cluster_c746f4c8-5588-cbfc-185a-d7ae205d161f, deleteOnExit=true 2023-02-16 17:01:42,745 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 17:01:42,745 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/test.cache.data in system properties and HBase conf 2023-02-16 17:01:42,745 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 17:01:42,745 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/hadoop.log.dir in system properties and HBase conf 2023-02-16 17:01:42,745 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 17:01:42,745 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 17:01:42,745 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 17:01:42,745 DEBUG [Listener at localhost/35457] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 17:01:42,745 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:01:42,746 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:01:42,746 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 17:01:42,746 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:01:42,746 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 17:01:42,746 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 17:01:42,746 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:01:42,746 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:01:42,746 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 17:01:42,746 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/nfs.dump.dir in system properties and HBase conf 2023-02-16 17:01:42,746 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/java.io.tmpdir in system properties and HBase conf 2023-02-16 17:01:42,746 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:01:42,746 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 17:01:42,747 INFO [Listener at localhost/35457] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 17:01:42,751 WARN [Listener at localhost/35457] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:01:42,751 WARN [Listener at localhost/35457] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:01:42,792 WARN [Listener at localhost/35457] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:42,793 INFO [Listener at localhost/35457] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:42,800 INFO [Listener at localhost/35457] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/java.io.tmpdir/Jetty_localhost_38979_hdfs____4giwao/webapp 2023-02-16 17:01:42,895 INFO [Listener at localhost/35457] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38979 2023-02-16 17:01:42,900 WARN [Listener at localhost/35457] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:01:42,900 WARN [Listener at localhost/35457] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:01:42,937 WARN [Listener at localhost/40647] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:42,950 WARN [Listener at localhost/40647] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:42,953 WARN [Listener at localhost/40647] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:42,954 INFO [Listener at localhost/40647] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:42,960 INFO [Listener at localhost/40647] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/java.io.tmpdir/Jetty_localhost_43081_datanode____.cwe767/webapp 2023-02-16 17:01:43,057 INFO [Listener at localhost/40647] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43081 2023-02-16 17:01:43,066 WARN [Listener at localhost/41925] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:43,078 WARN [Listener at localhost/41925] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:43,080 WARN [Listener at localhost/41925] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:43,081 INFO [Listener at localhost/41925] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:43,083 INFO [Listener at localhost/41925] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/java.io.tmpdir/Jetty_localhost_41217_datanode____c8e6jm/webapp 2023-02-16 17:01:43,174 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7dd51e666f36feea: Processing first storage report for DS-b78b8154-4f1c-4552-b0a6-d5ddd4a0ea5a from datanode 85202b67-afd4-45ae-820d-4278393abd77 2023-02-16 17:01:43,174 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7dd51e666f36feea: from storage DS-b78b8154-4f1c-4552-b0a6-d5ddd4a0ea5a node DatanodeRegistration(127.0.0.1:41799, datanodeUuid=85202b67-afd4-45ae-820d-4278393abd77, infoPort=36507, infoSecurePort=0, ipcPort=41925, storageInfo=lv=-57;cid=testClusterID;nsid=688820003;c=1676566902753), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:43,174 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7dd51e666f36feea: Processing first storage report for DS-d7cff998-1df7-4a2f-88aa-b659fa956951 from datanode 85202b67-afd4-45ae-820d-4278393abd77 2023-02-16 17:01:43,174 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7dd51e666f36feea: from storage DS-d7cff998-1df7-4a2f-88aa-b659fa956951 node DatanodeRegistration(127.0.0.1:41799, datanodeUuid=85202b67-afd4-45ae-820d-4278393abd77, infoPort=36507, infoSecurePort=0, ipcPort=41925, storageInfo=lv=-57;cid=testClusterID;nsid=688820003;c=1676566902753), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:43,197 INFO [Listener at localhost/41925] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41217 2023-02-16 17:01:43,224 WARN [Listener at localhost/37745] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:43,316 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x16d56f2676c302ee: Processing first storage report for DS-a50e93b9-1641-41cd-bdec-28c7108984c0 from datanode f6198ebd-aaba-4992-aa0c-4760b634d64b 2023-02-16 17:01:43,316 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x16d56f2676c302ee: from storage DS-a50e93b9-1641-41cd-bdec-28c7108984c0 node DatanodeRegistration(127.0.0.1:41999, datanodeUuid=f6198ebd-aaba-4992-aa0c-4760b634d64b, infoPort=34477, infoSecurePort=0, ipcPort=37745, storageInfo=lv=-57;cid=testClusterID;nsid=688820003;c=1676566902753), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:43,316 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x16d56f2676c302ee: Processing first storage report for DS-bfd71d6c-8d8e-4ea1-9006-11502416488a from datanode f6198ebd-aaba-4992-aa0c-4760b634d64b 2023-02-16 17:01:43,316 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x16d56f2676c302ee: from storage DS-bfd71d6c-8d8e-4ea1-9006-11502416488a node DatanodeRegistration(127.0.0.1:41999, datanodeUuid=f6198ebd-aaba-4992-aa0c-4760b634d64b, infoPort=34477, infoSecurePort=0, ipcPort=37745, storageInfo=lv=-57;cid=testClusterID;nsid=688820003;c=1676566902753), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:43,334 DEBUG [Listener at localhost/37745] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2 2023-02-16 17:01:43,336 INFO [Listener at localhost/37745] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/cluster_c746f4c8-5588-cbfc-185a-d7ae205d161f/zookeeper_0, clientPort=51006, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/cluster_c746f4c8-5588-cbfc-185a-d7ae205d161f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/cluster_c746f4c8-5588-cbfc-185a-d7ae205d161f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 17:01:43,337 INFO [Listener at localhost/37745] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51006 2023-02-16 17:01:43,337 INFO [Listener at localhost/37745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:43,338 INFO [Listener at localhost/37745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:43,350 INFO [Listener at localhost/37745] util.FSUtils(479): Created version file at hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692 with version=8 2023-02-16 17:01:43,350 INFO [Listener at localhost/37745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:43,351 INFO [Listener at localhost/37745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:43,352 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40647/user/jenkins/test-data/b173b7c2-42bb-3edb-9704-8043f12375c8/hbase-staging 2023-02-16 17:01:43,353 INFO [Listener at localhost/37745] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:43,354 INFO [Listener at localhost/37745] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:43,354 INFO [Listener at localhost/37745] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:43,354 INFO [Listener at localhost/37745] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:43,354 INFO [Listener at localhost/37745] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:43,354 INFO [Listener at localhost/37745] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:43,354 INFO [Listener at localhost/37745] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:43,355 INFO [Listener at localhost/37745] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34685 2023-02-16 17:01:43,355 INFO [Listener at localhost/37745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:43,356 INFO [Listener at localhost/37745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:43,356 INFO [Listener at localhost/37745] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34685 connecting to ZooKeeper ensemble=127.0.0.1:51006 2023-02-16 17:01:43,363 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:346850x0, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:43,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34685-0x1005e14a3ec0000 connected 2023-02-16 17:01:43,383 DEBUG [Listener at localhost/37745] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:43,383 DEBUG [Listener at localhost/37745] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:43,384 DEBUG [Listener at localhost/37745] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:43,384 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34685 2023-02-16 17:01:43,387 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34685 2023-02-16 17:01:43,387 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34685 2023-02-16 17:01:43,388 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34685 2023-02-16 17:01:43,389 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34685 2023-02-16 17:01:43,389 INFO [Listener at localhost/37745] master.HMaster(444): hbase.rootdir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692, hbase.cluster.distributed=false 2023-02-16 17:01:43,403 INFO [Listener at localhost/37745] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:43,403 INFO [Listener at localhost/37745] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:43,403 INFO [Listener at localhost/37745] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:43,403 INFO [Listener at localhost/37745] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:43,404 INFO [Listener at localhost/37745] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:43,404 INFO [Listener at localhost/37745] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:43,404 INFO [Listener at localhost/37745] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:43,404 INFO [Listener at localhost/37745] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33419 2023-02-16 17:01:43,405 INFO [Listener at localhost/37745] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:43,407 DEBUG [Listener at localhost/37745] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:43,408 INFO [Listener at localhost/37745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:43,409 INFO [Listener at localhost/37745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:43,410 INFO [Listener at localhost/37745] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33419 connecting to ZooKeeper ensemble=127.0.0.1:51006 2023-02-16 17:01:43,414 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:334190x0, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:43,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33419-0x1005e14a3ec0001 connected 2023-02-16 17:01:43,417 DEBUG [Listener at localhost/37745] zookeeper.ZKUtil(164): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:43,417 DEBUG [Listener at localhost/37745] zookeeper.ZKUtil(164): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:43,418 DEBUG [Listener at localhost/37745] zookeeper.ZKUtil(164): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:43,418 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33419 2023-02-16 17:01:43,419 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33419 2023-02-16 17:01:43,419 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33419 2023-02-16 17:01:43,419 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33419 2023-02-16 17:01:43,420 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33419 2023-02-16 17:01:43,434 INFO [Listener at localhost/37745] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:43,435 INFO [Listener at localhost/37745] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:43,435 INFO [Listener at localhost/37745] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:43,435 INFO [Listener at localhost/37745] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:43,435 INFO [Listener at localhost/37745] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:43,435 INFO [Listener at localhost/37745] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:43,435 INFO [Listener at localhost/37745] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:43,436 INFO [Listener at localhost/37745] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46069 2023-02-16 17:01:43,436 INFO [Listener at localhost/37745] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:43,436 DEBUG [Listener at localhost/37745] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:43,437 INFO [Listener at localhost/37745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:43,438 INFO [Listener at localhost/37745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:43,438 INFO [Listener at localhost/37745] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46069 connecting to ZooKeeper ensemble=127.0.0.1:51006 2023-02-16 17:01:43,442 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:460690x0, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:43,443 DEBUG [Listener at localhost/37745] zookeeper.ZKUtil(164): regionserver:460690x0, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:43,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46069-0x1005e14a3ec0002 connected 2023-02-16 17:01:43,444 DEBUG [Listener at localhost/37745] zookeeper.ZKUtil(164): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:43,444 DEBUG [Listener at localhost/37745] zookeeper.ZKUtil(164): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:43,444 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46069 2023-02-16 17:01:43,444 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46069 2023-02-16 17:01:43,445 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46069 2023-02-16 17:01:43,445 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46069 2023-02-16 17:01:43,445 DEBUG [Listener at localhost/37745] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46069 2023-02-16 17:01:43,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34685,1676566903353 2023-02-16 17:01:43,449 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:43,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34685,1676566903353 2023-02-16 17:01:43,450 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:43,450 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:43,450 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:43,450 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:43,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:43,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34685,1676566903353 from backup master directory 2023-02-16 17:01:43,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:43,454 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34685,1676566903353 2023-02-16 17:01:43,454 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:43,454 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:43,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34685,1676566903353 2023-02-16 17:01:43,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/hbase.id with ID: b68b365a-7b2b-452b-82c3-b99a7e836ab8 2023-02-16 17:01:43,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:43,473 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:43,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2af3f48c to 127.0.0.1:51006 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:43,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a12f6dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:43,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:43,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 17:01:43,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:43,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/data/master/store-tmp 2023-02-16 17:01:43,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:43,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:43,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:43,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:43,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:43,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:43,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:43,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:43,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/WALs/jenkins-hbase4.apache.org,34685,1676566903353 2023-02-16 17:01:43,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34685%2C1676566903353, suffix=, logDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/WALs/jenkins-hbase4.apache.org,34685,1676566903353, archiveDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/oldWALs, maxLogs=10 2023-02-16 17:01:43,506 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41999,DS-a50e93b9-1641-41cd-bdec-28c7108984c0,DISK] 2023-02-16 17:01:43,506 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41799,DS-b78b8154-4f1c-4552-b0a6-d5ddd4a0ea5a,DISK] 2023-02-16 17:01:43,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/WALs/jenkins-hbase4.apache.org,34685,1676566903353/jenkins-hbase4.apache.org%2C34685%2C1676566903353.1676566903493 2023-02-16 17:01:43,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41999,DS-a50e93b9-1641-41cd-bdec-28c7108984c0,DISK], DatanodeInfoWithStorage[127.0.0.1:41799,DS-b78b8154-4f1c-4552-b0a6-d5ddd4a0ea5a,DISK]] 2023-02-16 17:01:43,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:43,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:43,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:43,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:43,509 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:43,510 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 17:01:43,510 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 17:01:43,511 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:43,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:43,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:43,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:43,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:43,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72413921, jitterRate=0.07905150949954987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:43,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:43,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 17:01:43,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 17:01:43,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 17:01:43,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 17:01:43,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 17:01:43,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 17:01:43,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 17:01:43,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 17:01:43,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 17:01:43,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 17:01:43,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 17:01:43,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 17:01:43,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 17:01:43,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 17:01:43,532 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:43,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 17:01:43,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 17:01:43,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 17:01:43,535 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:43,535 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:43,535 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:43,535 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:43,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34685,1676566903353, sessionid=0x1005e14a3ec0000, setting cluster-up flag (Was=false) 2023-02-16 17:01:43,541 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:43,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 17:01:43,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34685,1676566903353 2023-02-16 17:01:43,552 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:43,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 17:01:43,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34685,1676566903353 2023-02-16 17:01:43,559 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.hbase-snapshot/.tmp 2023-02-16 17:01:43,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:43,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:43,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:43,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:43,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:43,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 17:01:43,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:43,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676566933562 2023-02-16 17:01:43,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 17:01:43,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 17:01:43,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 17:01:43,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 17:01:43,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 17:01:43,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 17:01:43,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,564 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:43,564 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 17:01:43,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 17:01:43,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 17:01:43,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 17:01:43,565 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:43,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 17:01:43,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 17:01:43,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566903571,5,FailOnTimeoutGroup] 2023-02-16 17:01:43,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566903572,5,FailOnTimeoutGroup] 2023-02-16 17:01:43,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 17:01:43,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,586 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:43,587 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:43,587 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692 2023-02-16 17:01:43,597 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:43,600 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:43,601 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/info 2023-02-16 17:01:43,601 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:43,602 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:43,602 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:43,603 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:43,603 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:43,603 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:43,603 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:43,604 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/table 2023-02-16 17:01:43,605 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:43,605 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:43,605 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740 2023-02-16 17:01:43,606 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740 2023-02-16 17:01:43,607 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:43,608 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:43,609 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:43,610 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65187031, jitterRate=-0.028637543320655823}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:43,610 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:43,610 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:43,610 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:43,610 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:43,610 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:43,610 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:43,610 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:43,610 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:43,611 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:43,611 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 17:01:43,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 17:01:43,613 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 17:01:43,614 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 17:01:43,647 INFO [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(952): ClusterId : b68b365a-7b2b-452b-82c3-b99a7e836ab8 2023-02-16 17:01:43,648 INFO [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(952): ClusterId : b68b365a-7b2b-452b-82c3-b99a7e836ab8 2023-02-16 17:01:43,648 DEBUG [RS:0;jenkins-hbase4:33419] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:43,648 DEBUG [RS:1;jenkins-hbase4:46069] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:43,650 DEBUG [RS:0;jenkins-hbase4:33419] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:43,650 DEBUG [RS:0;jenkins-hbase4:33419] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:43,650 DEBUG [RS:1;jenkins-hbase4:46069] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:43,650 DEBUG [RS:1;jenkins-hbase4:46069] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:43,653 DEBUG [RS:0;jenkins-hbase4:33419] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:43,655 DEBUG [RS:0;jenkins-hbase4:33419] zookeeper.ReadOnlyZKClient(139): Connect 0x06e42e63 to 127.0.0.1:51006 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:43,655 DEBUG [RS:1;jenkins-hbase4:46069] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:43,657 DEBUG [RS:1;jenkins-hbase4:46069] zookeeper.ReadOnlyZKClient(139): Connect 0x5a47cb12 to 127.0.0.1:51006 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:43,666 DEBUG [RS:0;jenkins-hbase4:33419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@823c0cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:43,667 DEBUG [RS:0;jenkins-hbase4:33419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c1c4513, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:43,667 DEBUG [RS:1;jenkins-hbase4:46069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54802e2a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:43,667 DEBUG [RS:1;jenkins-hbase4:46069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50bfa062, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:43,675 DEBUG [RS:0;jenkins-hbase4:33419] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33419 2023-02-16 17:01:43,675 DEBUG [RS:1;jenkins-hbase4:46069] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46069 2023-02-16 17:01:43,675 INFO [RS:0;jenkins-hbase4:33419] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:43,675 INFO [RS:1;jenkins-hbase4:46069] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:43,676 INFO [RS:1;jenkins-hbase4:46069] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:43,676 INFO [RS:0;jenkins-hbase4:33419] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:43,676 DEBUG [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:43,676 DEBUG [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:43,676 INFO [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34685,1676566903353 with isa=jenkins-hbase4.apache.org/172.31.14.131:46069, startcode=1676566903434 2023-02-16 17:01:43,676 INFO [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34685,1676566903353 with isa=jenkins-hbase4.apache.org/172.31.14.131:33419, startcode=1676566903403 2023-02-16 17:01:43,676 DEBUG [RS:1;jenkins-hbase4:46069] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:43,676 DEBUG [RS:0;jenkins-hbase4:33419] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:43,679 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56337, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:43,679 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46421, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:43,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:43,680 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:43,681 DEBUG [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692 2023-02-16 17:01:43,681 DEBUG [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692 2023-02-16 17:01:43,681 DEBUG [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40647 2023-02-16 17:01:43,681 DEBUG [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40647 2023-02-16 17:01:43,681 DEBUG [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:43,681 DEBUG [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:43,686 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:43,686 DEBUG [RS:1;jenkins-hbase4:46069] zookeeper.ZKUtil(162): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:43,686 DEBUG [RS:0;jenkins-hbase4:33419] zookeeper.ZKUtil(162): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:43,686 WARN [RS:1;jenkins-hbase4:46069] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:43,686 WARN [RS:0;jenkins-hbase4:33419] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:43,686 INFO [RS:1;jenkins-hbase4:46069] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:43,687 INFO [RS:0;jenkins-hbase4:33419] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:43,687 DEBUG [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/WALs/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:43,687 DEBUG [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/WALs/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:43,687 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33419,1676566903403] 2023-02-16 17:01:43,687 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46069,1676566903434] 2023-02-16 17:01:43,694 DEBUG [RS:1;jenkins-hbase4:46069] zookeeper.ZKUtil(162): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:43,694 DEBUG [RS:0;jenkins-hbase4:33419] zookeeper.ZKUtil(162): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:43,694 DEBUG [RS:1;jenkins-hbase4:46069] zookeeper.ZKUtil(162): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:43,695 DEBUG [RS:0;jenkins-hbase4:33419] zookeeper.ZKUtil(162): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:43,695 DEBUG [RS:1;jenkins-hbase4:46069] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:43,695 DEBUG [RS:0;jenkins-hbase4:33419] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:43,695 INFO [RS:1;jenkins-hbase4:46069] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:43,695 INFO [RS:0;jenkins-hbase4:33419] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:43,696 INFO [RS:1;jenkins-hbase4:46069] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:43,697 INFO [RS:1;jenkins-hbase4:46069] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:43,697 INFO [RS:1;jenkins-hbase4:46069] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,697 INFO [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:43,702 INFO [RS:1;jenkins-hbase4:46069] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,702 INFO [RS:0;jenkins-hbase4:33419] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:43,702 DEBUG [RS:1;jenkins-hbase4:46069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,702 DEBUG [RS:1;jenkins-hbase4:46069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,702 DEBUG [RS:1;jenkins-hbase4:46069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,702 DEBUG [RS:1;jenkins-hbase4:46069] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,702 DEBUG [RS:1;jenkins-hbase4:46069] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,702 DEBUG [RS:1;jenkins-hbase4:46069] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:43,702 DEBUG [RS:1;jenkins-hbase4:46069] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,702 INFO [RS:0;jenkins-hbase4:33419] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:43,703 DEBUG [RS:1;jenkins-hbase4:46069] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,703 INFO [RS:0;jenkins-hbase4:33419] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,703 DEBUG [RS:1;jenkins-hbase4:46069] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,703 DEBUG [RS:1;jenkins-hbase4:46069] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,704 INFO [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:43,705 INFO [RS:1;jenkins-hbase4:46069] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,705 INFO [RS:1;jenkins-hbase4:46069] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,705 INFO [RS:1;jenkins-hbase4:46069] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,706 INFO [RS:0;jenkins-hbase4:33419] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,706 DEBUG [RS:0;jenkins-hbase4:33419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,706 DEBUG [RS:0;jenkins-hbase4:33419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,706 DEBUG [RS:0;jenkins-hbase4:33419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,706 DEBUG [RS:0;jenkins-hbase4:33419] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,706 DEBUG [RS:0;jenkins-hbase4:33419] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,706 DEBUG [RS:0;jenkins-hbase4:33419] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:43,707 DEBUG [RS:0;jenkins-hbase4:33419] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,707 DEBUG [RS:0;jenkins-hbase4:33419] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,707 DEBUG [RS:0;jenkins-hbase4:33419] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,707 DEBUG [RS:0;jenkins-hbase4:33419] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:43,707 INFO [RS:0;jenkins-hbase4:33419] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,707 INFO [RS:0;jenkins-hbase4:33419] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,708 INFO [RS:0;jenkins-hbase4:33419] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,717 INFO [RS:1;jenkins-hbase4:46069] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:43,717 INFO [RS:1;jenkins-hbase4:46069] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46069,1676566903434-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,718 INFO [RS:0;jenkins-hbase4:33419] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:43,718 INFO [RS:0;jenkins-hbase4:33419] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33419,1676566903403-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,728 INFO [RS:1;jenkins-hbase4:46069] regionserver.Replication(203): jenkins-hbase4.apache.org,46069,1676566903434 started 2023-02-16 17:01:43,728 INFO [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46069,1676566903434, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46069, sessionid=0x1005e14a3ec0002 2023-02-16 17:01:43,728 INFO [RS:0;jenkins-hbase4:33419] regionserver.Replication(203): jenkins-hbase4.apache.org,33419,1676566903403 started 2023-02-16 17:01:43,728 DEBUG [RS:1;jenkins-hbase4:46069] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:43,728 DEBUG [RS:1;jenkins-hbase4:46069] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:43,728 INFO [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33419,1676566903403, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33419, sessionid=0x1005e14a3ec0001 2023-02-16 17:01:43,728 DEBUG [RS:1;jenkins-hbase4:46069] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46069,1676566903434' 2023-02-16 17:01:43,728 DEBUG [RS:0;jenkins-hbase4:33419] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:43,728 DEBUG [RS:1;jenkins-hbase4:46069] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:43,728 DEBUG [RS:0;jenkins-hbase4:33419] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:43,728 DEBUG [RS:0;jenkins-hbase4:33419] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33419,1676566903403' 2023-02-16 17:01:43,728 DEBUG [RS:0;jenkins-hbase4:33419] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:43,728 DEBUG [RS:1;jenkins-hbase4:46069] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:43,728 DEBUG [RS:0;jenkins-hbase4:33419] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:43,729 DEBUG [RS:1;jenkins-hbase4:46069] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:43,729 DEBUG [RS:1;jenkins-hbase4:46069] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:43,729 DEBUG [RS:1;jenkins-hbase4:46069] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:43,729 DEBUG [RS:1;jenkins-hbase4:46069] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46069,1676566903434' 2023-02-16 17:01:43,729 DEBUG [RS:1;jenkins-hbase4:46069] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:43,729 DEBUG [RS:0;jenkins-hbase4:33419] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:43,729 DEBUG [RS:0;jenkins-hbase4:33419] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:43,729 DEBUG [RS:0;jenkins-hbase4:33419] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:43,729 DEBUG [RS:0;jenkins-hbase4:33419] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33419,1676566903403' 2023-02-16 17:01:43,729 DEBUG [RS:0;jenkins-hbase4:33419] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:43,729 DEBUG [RS:1;jenkins-hbase4:46069] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:43,729 DEBUG [RS:0;jenkins-hbase4:33419] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:43,729 DEBUG [RS:1;jenkins-hbase4:46069] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:43,729 INFO [RS:1;jenkins-hbase4:46069] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:43,729 INFO [RS:1;jenkins-hbase4:46069] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:43,729 DEBUG [RS:0;jenkins-hbase4:33419] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:43,729 INFO [RS:0;jenkins-hbase4:33419] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:43,729 INFO [RS:0;jenkins-hbase4:33419] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:43,764 DEBUG [jenkins-hbase4:34685] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 17:01:43,764 DEBUG [jenkins-hbase4:34685] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:43,765 DEBUG [jenkins-hbase4:34685] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:43,765 DEBUG [jenkins-hbase4:34685] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:43,765 DEBUG [jenkins-hbase4:34685] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:43,766 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46069,1676566903434, state=OPENING 2023-02-16 17:01:43,768 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 17:01:43,769 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:43,771 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:43,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46069,1676566903434}] 2023-02-16 17:01:43,925 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:43,926 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:43,927 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54860, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:43,931 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 17:01:43,931 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:43,933 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46069%2C1676566903434.meta, suffix=.meta, logDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/WALs/jenkins-hbase4.apache.org,46069,1676566903434, archiveDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/oldWALs, maxLogs=32 2023-02-16 17:01:43,946 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41799,DS-b78b8154-4f1c-4552-b0a6-d5ddd4a0ea5a,DISK] 2023-02-16 17:01:43,946 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41999,DS-a50e93b9-1641-41cd-bdec-28c7108984c0,DISK] 2023-02-16 17:01:43,947 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/WALs/jenkins-hbase4.apache.org,46069,1676566903434/jenkins-hbase4.apache.org%2C46069%2C1676566903434.meta.1676566903933.meta 2023-02-16 17:01:43,948 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41799,DS-b78b8154-4f1c-4552-b0a6-d5ddd4a0ea5a,DISK], DatanodeInfoWithStorage[127.0.0.1:41999,DS-a50e93b9-1641-41cd-bdec-28c7108984c0,DISK]] 2023-02-16 17:01:43,948 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:43,948 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 17:01:43,948 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 17:01:43,948 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 17:01:43,948 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 17:01:43,948 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:43,949 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 17:01:43,949 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 17:01:43,952 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:43,953 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/info 2023-02-16 17:01:43,953 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/info 2023-02-16 17:01:43,954 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:43,954 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:43,954 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:43,955 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:43,955 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:43,956 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:43,956 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:43,956 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:43,958 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/table 2023-02-16 17:01:43,958 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/table 2023-02-16 17:01:43,958 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:43,959 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:43,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740 2023-02-16 17:01:43,961 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740 2023-02-16 17:01:43,963 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:43,965 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:43,965 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63928329, jitterRate=-0.047393664717674255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:43,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:43,966 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676566903925 2023-02-16 17:01:43,970 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 17:01:43,971 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 17:01:43,971 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46069,1676566903434, state=OPEN 2023-02-16 17:01:43,973 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 17:01:43,973 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:43,974 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 17:01:43,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46069,1676566903434 in 204 msec 2023-02-16 17:01:43,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 17:01:43,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 364 msec 2023-02-16 17:01:43,977 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 416 msec 2023-02-16 17:01:43,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676566903978, completionTime=-1 2023-02-16 17:01:43,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 17:01:43,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 17:01:43,981 DEBUG [hconnection-0x31e50bce-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:43,983 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54868, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:43,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 17:01:43,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676566963984 2023-02-16 17:01:43,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676567023985 2023-02-16 17:01:43,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-16 17:01:43,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34685,1676566903353-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34685,1676566903353-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34685,1676566903353-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34685, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:43,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 17:01:43,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:43,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 17:01:43,994 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 17:01:43,996 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:43,996 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:43,997 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05 2023-02-16 17:01:43,998 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05 empty. 2023-02-16 17:01:43,998 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05 2023-02-16 17:01:43,998 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 17:01:44,007 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:44,008 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5e93f336ca1a30c9d8830cd072ae7e05, NAME => 'hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp 2023-02-16 17:01:44,013 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:44,013 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 5e93f336ca1a30c9d8830cd072ae7e05, disabling compactions & flushes 2023-02-16 17:01:44,013 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. 2023-02-16 17:01:44,013 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. 2023-02-16 17:01:44,013 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. after waiting 0 ms 2023-02-16 17:01:44,013 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. 2023-02-16 17:01:44,013 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. 2023-02-16 17:01:44,013 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 5e93f336ca1a30c9d8830cd072ae7e05: 2023-02-16 17:01:44,015 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:44,016 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566904016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566904016"}]},"ts":"1676566904016"} 2023-02-16 17:01:44,018 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 17:01:44,019 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:44,019 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566904019"}]},"ts":"1676566904019"} 2023-02-16 17:01:44,020 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 17:01:44,022 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:44,023 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:44,023 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:44,023 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:44,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5e93f336ca1a30c9d8830cd072ae7e05, ASSIGN}] 2023-02-16 17:01:44,026 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5e93f336ca1a30c9d8830cd072ae7e05, ASSIGN 2023-02-16 17:01:44,026 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5e93f336ca1a30c9d8830cd072ae7e05, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33419,1676566903403; forceNewPlan=false, retain=false 2023-02-16 17:01:44,176 INFO [jenkins-hbase4:34685] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 17:01:44,177 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5e93f336ca1a30c9d8830cd072ae7e05, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:44,177 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566904176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566904176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566904176"}]},"ts":"1676566904176"} 2023-02-16 17:01:44,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5e93f336ca1a30c9d8830cd072ae7e05, server=jenkins-hbase4.apache.org,33419,1676566903403}] 2023-02-16 17:01:44,330 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:44,330 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:44,332 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58944, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:44,335 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. 2023-02-16 17:01:44,336 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33419%2C1676566903403, suffix=, logDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/WALs/jenkins-hbase4.apache.org,33419,1676566903403, archiveDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/oldWALs, maxLogs=32 2023-02-16 17:01:44,349 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41999,DS-a50e93b9-1641-41cd-bdec-28c7108984c0,DISK] 2023-02-16 17:01:44,350 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41799,DS-b78b8154-4f1c-4552-b0a6-d5ddd4a0ea5a,DISK] 2023-02-16 17:01:44,351 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/WALs/jenkins-hbase4.apache.org,33419,1676566903403/jenkins-hbase4.apache.org%2C33419%2C1676566903403.1676566904336 2023-02-16 17:01:44,351 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41999,DS-a50e93b9-1641-41cd-bdec-28c7108984c0,DISK], DatanodeInfoWithStorage[127.0.0.1:41799,DS-b78b8154-4f1c-4552-b0a6-d5ddd4a0ea5a,DISK]] 2023-02-16 17:01:44,351 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5e93f336ca1a30c9d8830cd072ae7e05, NAME => 'hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:44,352 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5e93f336ca1a30c9d8830cd072ae7e05 2023-02-16 17:01:44,352 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:44,352 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5e93f336ca1a30c9d8830cd072ae7e05 2023-02-16 17:01:44,352 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5e93f336ca1a30c9d8830cd072ae7e05 2023-02-16 17:01:44,353 INFO [StoreOpener-5e93f336ca1a30c9d8830cd072ae7e05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5e93f336ca1a30c9d8830cd072ae7e05 2023-02-16 17:01:44,354 DEBUG [StoreOpener-5e93f336ca1a30c9d8830cd072ae7e05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05/info 2023-02-16 17:01:44,354 DEBUG [StoreOpener-5e93f336ca1a30c9d8830cd072ae7e05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05/info 2023-02-16 17:01:44,354 INFO [StoreOpener-5e93f336ca1a30c9d8830cd072ae7e05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e93f336ca1a30c9d8830cd072ae7e05 columnFamilyName info 2023-02-16 17:01:44,355 INFO [StoreOpener-5e93f336ca1a30c9d8830cd072ae7e05-1] regionserver.HStore(310): Store=5e93f336ca1a30c9d8830cd072ae7e05/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:44,355 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05 2023-02-16 17:01:44,355 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05 2023-02-16 17:01:44,357 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5e93f336ca1a30c9d8830cd072ae7e05 2023-02-16 17:01:44,358 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:44,359 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5e93f336ca1a30c9d8830cd072ae7e05; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63715370, jitterRate=-0.05056700110435486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:44,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5e93f336ca1a30c9d8830cd072ae7e05: 2023-02-16 17:01:44,359 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05., pid=6, masterSystemTime=1676566904330 2023-02-16 17:01:44,362 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. 2023-02-16 17:01:44,363 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. 2023-02-16 17:01:44,363 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5e93f336ca1a30c9d8830cd072ae7e05, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:44,363 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566904363"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566904363"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566904363"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566904363"}]},"ts":"1676566904363"} 2023-02-16 17:01:44,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 17:01:44,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5e93f336ca1a30c9d8830cd072ae7e05, server=jenkins-hbase4.apache.org,33419,1676566903403 in 186 msec 2023-02-16 17:01:44,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 17:01:44,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5e93f336ca1a30c9d8830cd072ae7e05, ASSIGN in 343 msec 2023-02-16 17:01:44,367 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:44,367 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566904367"}]},"ts":"1676566904367"} 2023-02-16 17:01:44,368 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 17:01:44,370 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:44,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 377 msec 2023-02-16 17:01:44,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 17:01:44,396 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:44,396 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:44,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:44,399 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58948, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:44,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 17:01:44,408 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:44,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-16 17:01:44,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 17:01:44,428 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:44,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-16 17:01:44,439 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 17:01:44,441 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 17:01:44,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.987sec 2023-02-16 17:01:44,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 17:01:44,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 17:01:44,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 17:01:44,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34685,1676566903353-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 17:01:44,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34685,1676566903353-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 17:01:44,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 17:01:44,448 DEBUG [Listener at localhost/37745] zookeeper.ReadOnlyZKClient(139): Connect 0x4e4c83c7 to 127.0.0.1:51006 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:44,459 DEBUG [Listener at localhost/37745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b99fe44, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:44,460 DEBUG [hconnection-0x3f3b4b33-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:44,462 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54884, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:44,463 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34685,1676566903353 2023-02-16 17:01:44,463 DEBUG [Listener at localhost/37745] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 17:01:44,465 DEBUG [Listener at localhost/37745] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 17:01:44,466 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 17:01:44,466 INFO [Listener at localhost/37745] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-16 17:01:44,467 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-16 17:01:44,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 17:01:44,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:41816 deadline: 1676566964467, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-16 17:01:44,467 INFO [Listener at localhost/37745] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-16 17:01:44,469 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:44,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:44,471 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:44,471 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-16 17:01:44,472 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:44,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:44,473 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:44,473 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59 empty. 2023-02-16 17:01:44,474 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:44,474 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-16 17:01:44,481 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:44,482 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => e5f5e618775ced2db420df105630aa59, NAME => 'testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp 2023-02-16 17:01:44,487 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:44,487 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing e5f5e618775ced2db420df105630aa59, disabling compactions & flushes 2023-02-16 17:01:44,487 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:44,487 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:44,487 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. after waiting 0 ms 2023-02-16 17:01:44,487 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:44,488 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:44,488 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for e5f5e618775ced2db420df105630aa59: 2023-02-16 17:01:44,489 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:44,490 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676566904490"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566904490"}]},"ts":"1676566904490"} 2023-02-16 17:01:44,491 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 17:01:44,491 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:44,492 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566904491"}]},"ts":"1676566904491"} 2023-02-16 17:01:44,492 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-16 17:01:44,496 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:44,497 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:44,497 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:44,497 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:44,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=e5f5e618775ced2db420df105630aa59, ASSIGN}] 2023-02-16 17:01:44,499 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=e5f5e618775ced2db420df105630aa59, ASSIGN 2023-02-16 17:01:44,499 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=e5f5e618775ced2db420df105630aa59, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33419,1676566903403; forceNewPlan=false, retain=false 2023-02-16 17:01:44,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:44,649 INFO [jenkins-hbase4:34685] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 17:01:44,650 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e5f5e618775ced2db420df105630aa59, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:44,650 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676566904650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566904650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566904650"}]},"ts":"1676566904650"} 2023-02-16 17:01:44,652 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure e5f5e618775ced2db420df105630aa59, server=jenkins-hbase4.apache.org,33419,1676566903403}] 2023-02-16 17:01:44,731 INFO [RS:1;jenkins-hbase4:46069] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46069%2C1676566903434, suffix=, logDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/WALs/jenkins-hbase4.apache.org,46069,1676566903434, archiveDir=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/oldWALs, maxLogs=32 2023-02-16 17:01:44,744 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41799,DS-b78b8154-4f1c-4552-b0a6-d5ddd4a0ea5a,DISK] 2023-02-16 17:01:44,744 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41999,DS-a50e93b9-1641-41cd-bdec-28c7108984c0,DISK] 2023-02-16 17:01:44,745 INFO [RS:1;jenkins-hbase4:46069] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/WALs/jenkins-hbase4.apache.org,46069,1676566903434/jenkins-hbase4.apache.org%2C46069%2C1676566903434.1676566904731 2023-02-16 17:01:44,746 DEBUG [RS:1;jenkins-hbase4:46069] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41799,DS-b78b8154-4f1c-4552-b0a6-d5ddd4a0ea5a,DISK], DatanodeInfoWithStorage[127.0.0.1:41999,DS-a50e93b9-1641-41cd-bdec-28c7108984c0,DISK]] 2023-02-16 17:01:44,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:44,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:44,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e5f5e618775ced2db420df105630aa59, NAME => 'testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:44,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:44,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:44,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:44,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:44,808 INFO [StoreOpener-e5f5e618775ced2db420df105630aa59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:44,809 DEBUG [StoreOpener-e5f5e618775ced2db420df105630aa59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1 2023-02-16 17:01:44,810 DEBUG [StoreOpener-e5f5e618775ced2db420df105630aa59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1 2023-02-16 17:01:44,810 INFO [StoreOpener-e5f5e618775ced2db420df105630aa59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f5e618775ced2db420df105630aa59 columnFamilyName f1 2023-02-16 17:01:44,810 INFO [StoreOpener-e5f5e618775ced2db420df105630aa59-1] regionserver.HStore(310): Store=e5f5e618775ced2db420df105630aa59/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:44,811 INFO [StoreOpener-e5f5e618775ced2db420df105630aa59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:44,812 DEBUG [StoreOpener-e5f5e618775ced2db420df105630aa59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2 2023-02-16 17:01:44,812 DEBUG [StoreOpener-e5f5e618775ced2db420df105630aa59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2 2023-02-16 17:01:44,813 INFO [StoreOpener-e5f5e618775ced2db420df105630aa59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f5e618775ced2db420df105630aa59 columnFamilyName f2 2023-02-16 17:01:44,813 INFO [StoreOpener-e5f5e618775ced2db420df105630aa59-1] regionserver.HStore(310): Store=e5f5e618775ced2db420df105630aa59/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:44,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:44,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:44,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:44,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:44,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:44,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e5f5e618775ced2db420df105630aa59; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70934921, jitterRate=0.05701269209384918}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:44,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e5f5e618775ced2db420df105630aa59: 2023-02-16 17:01:44,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59., pid=12, masterSystemTime=1676566904803 2023-02-16 17:01:44,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:44,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:44,823 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e5f5e618775ced2db420df105630aa59, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:44,823 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676566904823"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566904823"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566904823"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566904823"}]},"ts":"1676566904823"} 2023-02-16 17:01:44,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 17:01:44,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure e5f5e618775ced2db420df105630aa59, server=jenkins-hbase4.apache.org,33419,1676566903403 in 172 msec 2023-02-16 17:01:44,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 17:01:44,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=e5f5e618775ced2db420df105630aa59, ASSIGN in 329 msec 2023-02-16 17:01:44,828 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:44,828 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566904828"}]},"ts":"1676566904828"} 2023-02-16 17:01:44,829 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-16 17:01:44,832 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:44,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 363 msec 2023-02-16 17:01:45,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:45,076 INFO [Listener at localhost/37745] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-16 17:01:45,076 DEBUG [Listener at localhost/37745] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-16 17:01:45,076 INFO [Listener at localhost/37745] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:45,078 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-16 17:01:45,078 INFO [Listener at localhost/37745] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:45,078 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-16 17:01:45,078 INFO [Listener at localhost/37745] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 17:01:45,092 DEBUG [hconnection-0x3f3b4b33-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:45,104 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58956, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:45,111 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33419] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,198 INFO [Listener at localhost/37745] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 17:01:45,198 INFO [Listener at localhost/37745] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 17:01:45,199 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 17:01:45,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676566905199 (current time:1676566905199). 2023-02-16 17:01:45,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 17:01:45,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x54760524 to 127.0.0.1:51006 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:45,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a35e6bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:45,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:45,204 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54886, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:45,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54760524 to 127.0.0.1:51006 2023-02-16 17:01:45,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:45,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 17:01:45,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 17:01:45,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 17:01:45,209 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 17:01:45,209 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676567505209 2023-02-16 17:01:45,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-16 17:01:45,209 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,210 DEBUG [Listener at localhost/37745] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:45,211 DEBUG [Listener at localhost/37745] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 17:01:45,211 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-16 17:01:45,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 17:01:45,212 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-16 17:01:45,213 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 17:01:45,213 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676567505213 2023-02-16 17:01:45,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,224 INFO [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-16 17:01:45,224 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:45,225 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-16 17:01:45,225 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 17:01:45,226 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,226 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,227 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:45,227 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:45,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:45,227 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:45,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,227 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,227 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-16 17:01:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,228 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-16 17:01:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-16 17:01:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,228 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-16 17:01:45,228 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-16 17:01:45,228 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:45,230 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 17:01:45,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,230 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 17:01:45,230 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46069,1676566903434' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 17:01:45,230 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-16 17:01:45,230 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:45,231 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 17:01:45,231 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 17:01:45,231 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33419,1676566903403' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 17:01:45,232 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,233 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,233 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:45,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:45,233 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,233 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,233 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:45,233 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:45,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:45,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:45,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:45,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33419,1676566903403' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-16 17:01:45,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@409de113[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:45,235 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 17:01:45,235 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,238 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,238 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,238 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 17:01:45,238 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 17:01:45,238 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,238 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:45,238 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 17:01:45,238 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 17:01:45,238 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 17:01:45,238 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46069,1676566903434' in zk 2023-02-16 17:01:45,238 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,238 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. started... 2023-02-16 17:01:45,239 INFO [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e5f5e618775ced2db420df105630aa59 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 17:01:45,240 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 17:01:45,240 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:45,240 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 17:01:45,252 INFO [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/.tmp/f1/772c97003cb44e09ac773c6cd84a126a 2023-02-16 17:01:45,269 INFO [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/.tmp/f2/08e09af777194f8896f87db24aec2769 2023-02-16 17:01:45,272 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/.tmp/f1/772c97003cb44e09ac773c6cd84a126a as hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1/772c97003cb44e09ac773c6cd84a126a 2023-02-16 17:01:45,276 INFO [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1/772c97003cb44e09ac773c6cd84a126a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 17:01:45,276 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/.tmp/f2/08e09af777194f8896f87db24aec2769 as hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2/08e09af777194f8896f87db24aec2769 2023-02-16 17:01:45,280 INFO [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2/08e09af777194f8896f87db24aec2769, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 17:01:45,281 INFO [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for e5f5e618775ced2db420df105630aa59 in 42ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:45,281 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-16 17:01:45,281 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e5f5e618775ced2db420df105630aa59: 2023-02-16 17:01:45,281 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,281 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:45,281 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1/772c97003cb44e09ac773c6cd84a126a] hfiles 2023-02-16 17:01:45,281 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1/772c97003cb44e09ac773c6cd84a126a for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,282 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2/08e09af777194f8896f87db24aec2769] hfiles 2023-02-16 17:01:45,282 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2/08e09af777194f8896f87db24aec2769 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,287 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. completed. 2023-02-16 17:01:45,287 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,287 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 17:01:45,287 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 17:01:45,287 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,288 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 17:01:45,288 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33419,1676566903403' in zk 2023-02-16 17:01:45,291 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 17:01:45,291 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,291 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:45,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:45,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:45,291 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 17:01:45,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:45,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:45,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:45,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,33419,1676566903403': 2023-02-16 17:01:45,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33419,1676566903403' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 17:01:45,294 INFO [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-16 17:01:45,294 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:45,294 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:45,294 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,294 INFO [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 17:01:45,296 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,296 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:45,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:45,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,296 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:45,296 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,296 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:45,296 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:45,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:45,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,297 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:45,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,298 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:45,299 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:45,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:45,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,307 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:45,307 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:45,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,311 DEBUG [Listener at localhost/37745] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:45,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-16 17:01:45,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:45,313 DEBUG [Listener at localhost/37745] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 17:01:45,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,334 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-16 17:01:45,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,335 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676566905209Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676566905307 (+98 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676566905307Writing data manifest for testWithMockedMapReduceSingleRegion at 1676566905311 (+4 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676566905317 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676566905334 (+17 ms) 2023-02-16 17:01:45,337 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-16 17:01:45,338 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 127 msec 2023-02-16 17:01:45,513 DEBUG [Listener at localhost/37745] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:45,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-16 17:01:45,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 17:01:45,514 INFO [Listener at localhost/37745] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 17:01:45,518 INFO [Listener at localhost/37745] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 17:01:45,522 INFO [Listener at localhost/37745] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 17:01:45,549 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33419] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,635 INFO [Listener at localhost/37745] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 17:01:45,641 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 17:01:45,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,644 INFO [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-16 17:01:45,644 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:45,645 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-16 17:01:45,645 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 17:01:45,647 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,647 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,648 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:45,648 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:45,648 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:45,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:45,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:45,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:45,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,649 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,649 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:45,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:45,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,650 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:45,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,650 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,651 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,655 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-16 17:01:45,656 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:45,656 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-16 17:01:45,657 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 17:01:45,657 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:45,657 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 17:01:45,657 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 17:01:45,657 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 17:01:45,657 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,657 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 17:01:45,658 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46069,1676566903434' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 17:01:45,658 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. started... 2023-02-16 17:01:45,658 INFO [rs(jenkins-hbase4.apache.org,33419,1676566903403)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e5f5e618775ced2db420df105630aa59 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 17:01:45,659 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,660 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,660 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:45,691 INFO [rs(jenkins-hbase4.apache.org,33419,1676566903403)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/.tmp/f1/59c44f0b96774e508a4f79654812aa92 2023-02-16 17:01:45,712 INFO [rs(jenkins-hbase4.apache.org,33419,1676566903403)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/.tmp/f2/c251e480ee724ee08bcf603156f54838 2023-02-16 17:01:45,717 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/.tmp/f1/59c44f0b96774e508a4f79654812aa92 as hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1/59c44f0b96774e508a4f79654812aa92 2023-02-16 17:01:45,720 INFO [rs(jenkins-hbase4.apache.org,33419,1676566903403)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1/59c44f0b96774e508a4f79654812aa92, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 17:01:45,721 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/.tmp/f2/c251e480ee724ee08bcf603156f54838 as hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2/c251e480ee724ee08bcf603156f54838 2023-02-16 17:01:45,726 INFO [rs(jenkins-hbase4.apache.org,33419,1676566903403)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2/c251e480ee724ee08bcf603156f54838, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 17:01:45,727 INFO [rs(jenkins-hbase4.apache.org,33419,1676566903403)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for e5f5e618775ced2db420df105630aa59 in 69ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:45,728 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e5f5e618775ced2db420df105630aa59: 2023-02-16 17:01:45,728 DEBUG [rs(jenkins-hbase4.apache.org,33419,1676566903403)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 17:01:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 17:01:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-16 17:01:45,728 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33419,1676566903403' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-16 17:01:45,730 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,730 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:45,730 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,730 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:45,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33419,1676566903403' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-16 17:01:45,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44a26dd8[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:45,732 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 17:01:45,732 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,734 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,734 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,734 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 17:01:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,734 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 17:01:45,734 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 17:01:45,734 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-16 17:01:45,734 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33419,1676566903403' in zk 2023-02-16 17:01:45,734 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,735 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:45,734 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46069,1676566903434' in zk 2023-02-16 17:01:45,736 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 17:01:45,736 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-16 17:01:45,736 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,736 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,736 DEBUG [member: 'jenkins-hbase4.apache.org,46069,1676566903434' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 17:01:45,736 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:45,736 DEBUG [member: 'jenkins-hbase4.apache.org,33419,1676566903403' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-16 17:01:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,33419,1676566903403': 2023-02-16 17:01:45,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33419,1676566903403' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 17:01:45,739 INFO [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-16 17:01:45,739 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:45,739 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:45,739 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,739 INFO [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 17:01:45,740 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,740 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:45,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,740 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:45,740 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,740 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:45,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:45,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:45,741 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:45,741 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,742 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:45,743 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,745 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,745 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:45,745 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:45,745 DEBUG [(jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:45,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:45,745 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:45,745 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:45,745 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-16 17:01:45,745 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 17:01:45,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:45,745 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:45,745 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,746 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:45,746 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:45,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:45,746 DEBUG [Listener at localhost/37745] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:45,746 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,746 DEBUG [Listener at localhost/37745] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 17:01:45,746 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,746 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,746 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,846 DEBUG [Listener at localhost/37745] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 17:01:45,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 17:01:45,852 INFO [Listener at localhost/37745] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676566905199 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:45,852 DEBUG [Listener at localhost/37745] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40647/user/jenkins/test-data/b173b7c2-42bb-3edb-9704-8043f12375c8/testWithMockedMapReduceSingleRegion/48e7929c-ebd3-4a4f-8261-a45f4b35da79/data/default/testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,852 INFO [Listener at localhost/37745] snapshot.RestoreSnapshotHelper(239): region to add: e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:45,852 INFO [Listener at localhost/37745] snapshot.RestoreSnapshotHelper(585): clone region=e5f5e618775ced2db420df105630aa59 as e5f5e618775ced2db420df105630aa59 in snapshot testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,853 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e5f5e618775ced2db420df105630aa59, NAME => 'testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40647/user/jenkins/test-data/b173b7c2-42bb-3edb-9704-8043f12375c8/testWithMockedMapReduceSingleRegion/48e7929c-ebd3-4a4f-8261-a45f4b35da79 2023-02-16 17:01:45,861 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:45,861 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 772c97003cb44e09ac773c6cd84a126a from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,863 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 08e09af777194f8896f87db24aec2769 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,865 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e5f5e618775ced2db420df105630aa59, disabling compactions & flushes 2023-02-16 17:01:45,865 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,865 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,865 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. after waiting 0 ms 2023-02-16 17:01:45,865 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,865 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,865 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e5f5e618775ced2db420df105630aa59: 2023-02-16 17:01:45,865 INFO [Listener at localhost/37745] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676566905199 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:45,865 DEBUG [Listener at localhost/37745] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40647/user/jenkins/test-data/b173b7c2-42bb-3edb-9704-8043f12375c8/testWithMockedMapReduceSingleRegion/48e7929c-ebd3-4a4f-8261-a45f4b35da79 2023-02-16 17:01:45,865 DEBUG [Listener at localhost/37745] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40647/user/jenkins/test-data/b173b7c2-42bb-3edb-9704-8043f12375c8/testWithMockedMapReduceSingleRegion/48e7929c-ebd3-4a4f-8261-a45f4b35da79 2023-02-16 17:01:45,866 DEBUG [Listener at localhost/37745] util.CommonFSUtils(699): |-data/ 2023-02-16 17:01:45,866 DEBUG [Listener at localhost/37745] util.CommonFSUtils(699): |----default/ 2023-02-16 17:01:45,866 DEBUG [Listener at localhost/37745] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-16 17:01:45,866 DEBUG [Listener at localhost/37745] util.CommonFSUtils(699): |----------e5f5e618775ced2db420df105630aa59/ 2023-02-16 17:01:45,867 DEBUG [Listener at localhost/37745] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:45,867 DEBUG [Listener at localhost/37745] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:45,867 DEBUG [Listener at localhost/37745] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=e5f5e618775ced2db420df105630aa59-772c97003cb44e09ac773c6cd84a126a 2023-02-16 17:01:45,867 DEBUG [Listener at localhost/37745] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:45,867 DEBUG [Listener at localhost/37745] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=e5f5e618775ced2db420df105630aa59-08e09af777194f8896f87db24aec2769 2023-02-16 17:01:45,870 INFO [Listener at localhost/37745] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 17:01:45,873 DEBUG [Listener at localhost/37745] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:45,873 INFO [Listener at localhost/37745] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:45,873 DEBUG [Listener at localhost/37745] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:45,875 INFO [StoreOpener-e5f5e618775ced2db420df105630aa59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:45,876 DEBUG [StoreOpener-e5f5e618775ced2db420df105630aa59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/b173b7c2-42bb-3edb-9704-8043f12375c8/testWithMockedMapReduceSingleRegion/48e7929c-ebd3-4a4f-8261-a45f4b35da79/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1 2023-02-16 17:01:45,876 INFO [StoreOpener-e5f5e618775ced2db420df105630aa59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f5e618775ced2db420df105630aa59 columnFamilyName f1 2023-02-16 17:01:45,879 DEBUG [StoreOpener-e5f5e618775ced2db420df105630aa59-1] regionserver.HStore(539): loaded hdfs://localhost:40647/user/jenkins/test-data/b173b7c2-42bb-3edb-9704-8043f12375c8/testWithMockedMapReduceSingleRegion/48e7929c-ebd3-4a4f-8261-a45f4b35da79/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1/testWithMockedMapReduceSingleRegion=e5f5e618775ced2db420df105630aa59-772c97003cb44e09ac773c6cd84a126a 2023-02-16 17:01:45,880 INFO [StoreOpener-e5f5e618775ced2db420df105630aa59-1] regionserver.HStore(310): Store=e5f5e618775ced2db420df105630aa59/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:45,880 INFO [StoreOpener-e5f5e618775ced2db420df105630aa59-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:45,880 DEBUG [StoreOpener-e5f5e618775ced2db420df105630aa59-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40647/user/jenkins/test-data/b173b7c2-42bb-3edb-9704-8043f12375c8/testWithMockedMapReduceSingleRegion/48e7929c-ebd3-4a4f-8261-a45f4b35da79/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2 2023-02-16 17:01:45,881 INFO [StoreOpener-e5f5e618775ced2db420df105630aa59-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f5e618775ced2db420df105630aa59 columnFamilyName f2 2023-02-16 17:01:45,884 DEBUG [StoreOpener-e5f5e618775ced2db420df105630aa59-1] regionserver.HStore(539): loaded hdfs://localhost:40647/user/jenkins/test-data/b173b7c2-42bb-3edb-9704-8043f12375c8/testWithMockedMapReduceSingleRegion/48e7929c-ebd3-4a4f-8261-a45f4b35da79/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2/testWithMockedMapReduceSingleRegion=e5f5e618775ced2db420df105630aa59-08e09af777194f8896f87db24aec2769 2023-02-16 17:01:45,884 INFO [StoreOpener-e5f5e618775ced2db420df105630aa59-1] regionserver.HStore(310): Store=e5f5e618775ced2db420df105630aa59/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:45,884 DEBUG [Listener at localhost/37745] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:45,885 INFO [Listener at localhost/37745] regionserver.HRegion(1071): Opened e5f5e618775ced2db420df105630aa59; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59859577, jitterRate=-0.1080227941274643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:45,885 DEBUG [Listener at localhost/37745] regionserver.HRegion(964): Region open journal for e5f5e618775ced2db420df105630aa59: 2023-02-16 17:01:45,935 DEBUG [Listener at localhost/37745] regionserver.HRegion(1603): Closing e5f5e618775ced2db420df105630aa59, disabling compactions & flushes 2023-02-16 17:01:45,935 INFO [Listener at localhost/37745] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,935 DEBUG [Listener at localhost/37745] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,936 DEBUG [Listener at localhost/37745] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. after waiting 0 ms 2023-02-16 17:01:45,936 DEBUG [Listener at localhost/37745] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,936 INFO [Listener at localhost/37745] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:45,937 DEBUG [Listener at localhost/37745] regionserver.HRegion(1557): Region close journal for e5f5e618775ced2db420df105630aa59: 2023-02-16 17:01:45,940 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-16 17:01:45,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,943 INFO [Listener at localhost/37745] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,943 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:45,947 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566905946"}]},"ts":"1676566905946"} 2023-02-16 17:01:45,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 17:01:45,948 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-16 17:01:45,950 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-16 17:01:45,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=e5f5e618775ced2db420df105630aa59, UNASSIGN}] 2023-02-16 17:01:45,952 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=e5f5e618775ced2db420df105630aa59, UNASSIGN 2023-02-16 17:01:45,953 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e5f5e618775ced2db420df105630aa59, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:45,953 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676566905953"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566905953"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566905953"}]},"ts":"1676566905953"} 2023-02-16 17:01:45,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure e5f5e618775ced2db420df105630aa59, server=jenkins-hbase4.apache.org,33419,1676566903403}] 2023-02-16 17:01:46,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 17:01:46,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:46,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e5f5e618775ced2db420df105630aa59, disabling compactions & flushes 2023-02-16 17:01:46,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:46,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:46,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. after waiting 0 ms 2023-02-16 17:01:46,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:46,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:46,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59. 2023-02-16 17:01:46,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e5f5e618775ced2db420df105630aa59: 2023-02-16 17:01:46,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:46,115 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e5f5e618775ced2db420df105630aa59, regionState=CLOSED 2023-02-16 17:01:46,115 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676566906115"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566906115"}]},"ts":"1676566906115"} 2023-02-16 17:01:46,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 17:01:46,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure e5f5e618775ced2db420df105630aa59, server=jenkins-hbase4.apache.org,33419,1676566903403 in 162 msec 2023-02-16 17:01:46,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 17:01:46,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=e5f5e618775ced2db420df105630aa59, UNASSIGN in 167 msec 2023-02-16 17:01:46,120 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566906120"}]},"ts":"1676566906120"} 2023-02-16 17:01:46,121 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-16 17:01:46,123 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-16 17:01:46,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 180 msec 2023-02-16 17:01:46,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 17:01:46,250 INFO [Listener at localhost/37745] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-16 17:01:46,251 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-16 17:01:46,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:46,253 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:46,254 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:46,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 17:01:46,257 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:46,259 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1, FileablePath, hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2, FileablePath, hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/recovered.edits] 2023-02-16 17:01:46,262 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1/59c44f0b96774e508a4f79654812aa92 to hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/archive/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1/59c44f0b96774e508a4f79654812aa92 2023-02-16 17:01:46,263 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1/772c97003cb44e09ac773c6cd84a126a to hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/archive/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f1/772c97003cb44e09ac773c6cd84a126a 2023-02-16 17:01:46,265 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2/08e09af777194f8896f87db24aec2769 to hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/archive/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2/08e09af777194f8896f87db24aec2769 2023-02-16 17:01:46,266 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2/c251e480ee724ee08bcf603156f54838 to hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/archive/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/f2/c251e480ee724ee08bcf603156f54838 2023-02-16 17:01:46,269 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/recovered.edits/12.seqid to hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/archive/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59/recovered.edits/12.seqid 2023-02-16 17:01:46,269 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/.tmp/data/default/testWithMockedMapReduceSingleRegion/e5f5e618775ced2db420df105630aa59 2023-02-16 17:01:46,269 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-16 17:01:46,271 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:46,272 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-16 17:01:46,274 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-16 17:01:46,275 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:46,275 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-16 17:01:46,275 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566906275"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:46,276 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 17:01:46,276 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e5f5e618775ced2db420df105630aa59, NAME => 'testWithMockedMapReduceSingleRegion,,1676566904469.e5f5e618775ced2db420df105630aa59.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 17:01:46,276 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-16 17:01:46,276 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676566906276"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:46,277 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-16 17:01:46,279 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-16 17:01:46,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 28 msec 2023-02-16 17:01:46,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34685] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 17:01:46,356 INFO [Listener at localhost/37745] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-16 17:01:46,356 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 17:01:46,356 INFO [Listener at localhost/37745] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 17:01:46,356 DEBUG [Listener at localhost/37745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e4c83c7 to 127.0.0.1:51006 2023-02-16 17:01:46,356 DEBUG [Listener at localhost/37745] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:46,356 DEBUG [Listener at localhost/37745] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 17:01:46,356 DEBUG [Listener at localhost/37745] util.JVMClusterUtil(257): Found active master hash=1484794866, stopped=false 2023-02-16 17:01:46,356 INFO [Listener at localhost/37745] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34685,1676566903353 2023-02-16 17:01:46,359 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:46,359 INFO [Listener at localhost/37745] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 17:01:46,359 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:46,359 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:46,359 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:46,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:46,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:46,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:46,361 DEBUG [Listener at localhost/37745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2af3f48c to 127.0.0.1:51006 2023-02-16 17:01:46,361 DEBUG [Listener at localhost/37745] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:46,361 INFO [Listener at localhost/37745] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33419,1676566903403' ***** 2023-02-16 17:01:46,361 INFO [Listener at localhost/37745] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:46,361 INFO [Listener at localhost/37745] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46069,1676566903434' ***** 2023-02-16 17:01:46,361 INFO [Listener at localhost/37745] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:46,361 INFO [RS:0;jenkins-hbase4:33419] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:46,361 INFO [RS:0;jenkins-hbase4:33419] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:46,362 INFO [RS:1;jenkins-hbase4:46069] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:46,361 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:46,362 INFO [RS:1;jenkins-hbase4:46069] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:46,362 INFO [RS:0;jenkins-hbase4:33419] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:46,362 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:46,362 INFO [RS:1;jenkins-hbase4:46069] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:46,362 INFO [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(3304): Received CLOSE for 5e93f336ca1a30c9d8830cd072ae7e05 2023-02-16 17:01:46,363 INFO [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:46,363 INFO [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:46,363 DEBUG [RS:1;jenkins-hbase4:46069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a47cb12 to 127.0.0.1:51006 2023-02-16 17:01:46,363 DEBUG [RS:0;jenkins-hbase4:33419] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06e42e63 to 127.0.0.1:51006 2023-02-16 17:01:46,363 DEBUG [RS:1;jenkins-hbase4:46069] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:46,363 DEBUG [RS:0;jenkins-hbase4:33419] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:46,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5e93f336ca1a30c9d8830cd072ae7e05, disabling compactions & flushes 2023-02-16 17:01:46,363 INFO [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 17:01:46,363 INFO [RS:1;jenkins-hbase4:46069] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:46,363 DEBUG [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(1479): Online Regions={5e93f336ca1a30c9d8830cd072ae7e05=hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05.} 2023-02-16 17:01:46,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. 2023-02-16 17:01:46,364 INFO [RS:1;jenkins-hbase4:46069] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:46,364 INFO [RS:1;jenkins-hbase4:46069] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:46,364 DEBUG [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(1505): Waiting on 5e93f336ca1a30c9d8830cd072ae7e05 2023-02-16 17:01:46,364 INFO [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 17:01:46,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. 2023-02-16 17:01:46,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. after waiting 0 ms 2023-02-16 17:01:46,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. 2023-02-16 17:01:46,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 5e93f336ca1a30c9d8830cd072ae7e05 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 17:01:46,364 INFO [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 17:01:46,364 DEBUG [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-16 17:01:46,364 DEBUG [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 17:01:46,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:46,364 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:46,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:46,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:46,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:46,364 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-16 17:01:46,380 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/.tmp/info/0846c9ee903f48d3bb1d8b8d949d5fdf 2023-02-16 17:01:46,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05/.tmp/info/756b0ada3d44426c967347d57bfa7e6c 2023-02-16 17:01:46,384 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0846c9ee903f48d3bb1d8b8d949d5fdf 2023-02-16 17:01:46,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05/.tmp/info/756b0ada3d44426c967347d57bfa7e6c as hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05/info/756b0ada3d44426c967347d57bfa7e6c 2023-02-16 17:01:46,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05/info/756b0ada3d44426c967347d57bfa7e6c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 17:01:46,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5e93f336ca1a30c9d8830cd072ae7e05 in 25ms, sequenceid=6, compaction requested=false 2023-02-16 17:01:46,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/.tmp/rep_barrier/f7ce03a760e5430c85c2d15474b7bfbb 2023-02-16 17:01:46,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/namespace/5e93f336ca1a30c9d8830cd072ae7e05/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 17:01:46,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. 2023-02-16 17:01:46,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5e93f336ca1a30c9d8830cd072ae7e05: 2023-02-16 17:01:46,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676566903993.5e93f336ca1a30c9d8830cd072ae7e05. 2023-02-16 17:01:46,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7ce03a760e5430c85c2d15474b7bfbb 2023-02-16 17:01:46,406 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/.tmp/table/8ab0cf344c404cd895736d0e02bf5f8c 2023-02-16 17:01:46,408 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:46,410 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:46,412 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ab0cf344c404cd895736d0e02bf5f8c 2023-02-16 17:01:46,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/.tmp/info/0846c9ee903f48d3bb1d8b8d949d5fdf as hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/info/0846c9ee903f48d3bb1d8b8d949d5fdf 2023-02-16 17:01:46,416 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0846c9ee903f48d3bb1d8b8d949d5fdf 2023-02-16 17:01:46,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/info/0846c9ee903f48d3bb1d8b8d949d5fdf, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 17:01:46,417 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/.tmp/rep_barrier/f7ce03a760e5430c85c2d15474b7bfbb as hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/rep_barrier/f7ce03a760e5430c85c2d15474b7bfbb 2023-02-16 17:01:46,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7ce03a760e5430c85c2d15474b7bfbb 2023-02-16 17:01:46,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/rep_barrier/f7ce03a760e5430c85c2d15474b7bfbb, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 17:01:46,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/.tmp/table/8ab0cf344c404cd895736d0e02bf5f8c as hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/table/8ab0cf344c404cd895736d0e02bf5f8c 2023-02-16 17:01:46,428 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ab0cf344c404cd895736d0e02bf5f8c 2023-02-16 17:01:46,428 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/table/8ab0cf344c404cd895736d0e02bf5f8c, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 17:01:46,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 67ms, sequenceid=21, compaction requested=false 2023-02-16 17:01:46,435 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 17:01:46,436 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 17:01:46,436 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:46,436 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:46,436 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:46,564 INFO [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33419,1676566903403; all regions closed. 2023-02-16 17:01:46,564 INFO [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46069,1676566903434; all regions closed. 2023-02-16 17:01:46,568 DEBUG [RS:0;jenkins-hbase4:33419] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/oldWALs 2023-02-16 17:01:46,568 INFO [RS:0;jenkins-hbase4:33419] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33419%2C1676566903403:(num 1676566904336) 2023-02-16 17:01:46,568 DEBUG [RS:1;jenkins-hbase4:46069] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/oldWALs 2023-02-16 17:01:46,568 INFO [RS:1;jenkins-hbase4:46069] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46069%2C1676566903434.meta:.meta(num 1676566903933) 2023-02-16 17:01:46,568 DEBUG [RS:0;jenkins-hbase4:33419] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:46,568 INFO [RS:0;jenkins-hbase4:33419] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:46,568 INFO [RS:0;jenkins-hbase4:33419] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:46,569 INFO [RS:0;jenkins-hbase4:33419] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:46,569 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:46,569 INFO [RS:0;jenkins-hbase4:33419] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:46,569 INFO [RS:0;jenkins-hbase4:33419] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:46,570 INFO [RS:0;jenkins-hbase4:33419] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33419 2023-02-16 17:01:46,571 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:46,571 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:46,571 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:46,571 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33419,1676566903403 2023-02-16 17:01:46,572 ERROR [Listener at localhost/37745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7db0287c rejected from java.util.concurrent.ThreadPoolExecutor@798fa312[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:46,572 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:46,572 ERROR [Listener at localhost/37745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71f4c96c rejected from java.util.concurrent.ThreadPoolExecutor@798fa312[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:46,573 DEBUG [RS:1;jenkins-hbase4:46069] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/oldWALs 2023-02-16 17:01:46,573 INFO [RS:1;jenkins-hbase4:46069] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46069%2C1676566903434:(num 1676566904731) 2023-02-16 17:01:46,573 DEBUG [RS:1;jenkins-hbase4:46069] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:46,573 INFO [RS:1;jenkins-hbase4:46069] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:46,573 INFO [RS:1;jenkins-hbase4:46069] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:46,573 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:46,574 INFO [RS:1;jenkins-hbase4:46069] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46069 2023-02-16 17:01:46,574 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33419,1676566903403] 2023-02-16 17:01:46,574 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33419,1676566903403; numProcessing=1 2023-02-16 17:01:46,575 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:46,575 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46069,1676566903434 2023-02-16 17:01:46,575 ERROR [Listener at localhost/37745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4487080c rejected from java.util.concurrent.ThreadPoolExecutor@40b88444[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:46,576 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33419,1676566903403 already deleted, retry=false 2023-02-16 17:01:46,576 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33419,1676566903403 expired; onlineServers=1 2023-02-16 17:01:46,576 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46069,1676566903434] 2023-02-16 17:01:46,576 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46069,1676566903434; numProcessing=2 2023-02-16 17:01:46,578 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46069,1676566903434 already deleted, retry=false 2023-02-16 17:01:46,578 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46069,1676566903434 expired; onlineServers=0 2023-02-16 17:01:46,578 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34685,1676566903353' ***** 2023-02-16 17:01:46,578 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 17:01:46,579 DEBUG [M:0;jenkins-hbase4:34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cbfa43a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:46,579 INFO [M:0;jenkins-hbase4:34685] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34685,1676566903353 2023-02-16 17:01:46,579 INFO [M:0;jenkins-hbase4:34685] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34685,1676566903353; all regions closed. 2023-02-16 17:01:46,579 DEBUG [M:0;jenkins-hbase4:34685] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:46,579 DEBUG [M:0;jenkins-hbase4:34685] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 17:01:46,579 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 17:01:46,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566903571] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566903571,5,FailOnTimeoutGroup] 2023-02-16 17:01:46,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566903572] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566903572,5,FailOnTimeoutGroup] 2023-02-16 17:01:46,579 DEBUG [M:0;jenkins-hbase4:34685] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 17:01:46,581 INFO [M:0;jenkins-hbase4:34685] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 17:01:46,581 INFO [M:0;jenkins-hbase4:34685] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 17:01:46,581 INFO [M:0;jenkins-hbase4:34685] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 17:01:46,581 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:46,581 DEBUG [M:0;jenkins-hbase4:34685] master.HMaster(1512): Stopping service threads 2023-02-16 17:01:46,581 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:46,581 INFO [M:0;jenkins-hbase4:34685] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 17:01:46,581 ERROR [M:0;jenkins-hbase4:34685] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 17:01:46,581 INFO [M:0;jenkins-hbase4:34685] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 17:01:46,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:46,582 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 17:01:46,582 DEBUG [M:0;jenkins-hbase4:34685] zookeeper.ZKUtil(398): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 17:01:46,582 WARN [M:0;jenkins-hbase4:34685] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 17:01:46,582 INFO [M:0;jenkins-hbase4:34685] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 17:01:46,582 INFO [M:0;jenkins-hbase4:34685] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 17:01:46,582 DEBUG [M:0;jenkins-hbase4:34685] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:46,583 INFO [M:0;jenkins-hbase4:34685] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:46,583 DEBUG [M:0;jenkins-hbase4:34685] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:46,583 DEBUG [M:0;jenkins-hbase4:34685] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:46,583 DEBUG [M:0;jenkins-hbase4:34685] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:46,583 INFO [M:0;jenkins-hbase4:34685] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.11 KB heapSize=67.06 KB 2023-02-16 17:01:46,591 INFO [M:0;jenkins-hbase4:34685] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.11 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7ba5f36bc04447c7ba699a3ebb5a3f15 2023-02-16 17:01:46,594 DEBUG [M:0;jenkins-hbase4:34685] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7ba5f36bc04447c7ba699a3ebb5a3f15 as hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7ba5f36bc04447c7ba699a3ebb5a3f15 2023-02-16 17:01:46,598 INFO [M:0;jenkins-hbase4:34685] regionserver.HStore(1080): Added hdfs://localhost:40647/user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7ba5f36bc04447c7ba699a3ebb5a3f15, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 17:01:46,599 INFO [M:0;jenkins-hbase4:34685] regionserver.HRegion(2947): Finished flush of dataSize ~56.11 KB/57454, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-16 17:01:46,599 INFO [M:0;jenkins-hbase4:34685] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:46,599 DEBUG [M:0;jenkins-hbase4:34685] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:46,601 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/7534a6a0-8803-dc51-d180-ca25f344f692/MasterData/WALs/jenkins-hbase4.apache.org,34685,1676566903353/jenkins-hbase4.apache.org%2C34685%2C1676566903353.1676566903493 not finished, retry = 0 2023-02-16 17:01:46,702 INFO [M:0;jenkins-hbase4:34685] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 17:01:46,702 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:46,703 INFO [M:0;jenkins-hbase4:34685] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34685 2023-02-16 17:01:46,705 DEBUG [M:0;jenkins-hbase4:34685] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34685,1676566903353 already deleted, retry=false 2023-02-16 17:01:46,858 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:46,858 INFO [M:0;jenkins-hbase4:34685] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34685,1676566903353; zookeeper connection closed. 2023-02-16 17:01:46,859 ERROR [Listener at localhost/37745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@66b55ae6 rejected from java.util.concurrent.ThreadPoolExecutor@628ad2e8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:46,859 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): master:34685-0x1005e14a3ec0000, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:46,859 ERROR [Listener at localhost/37745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a4b93cd rejected from java.util.concurrent.ThreadPoolExecutor@628ad2e8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:46,871 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 17:01:46,992 INFO [RS:1;jenkins-hbase4:46069] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46069,1676566903434; zookeeper connection closed. 2023-02-16 17:01:46,992 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:46,993 ERROR [Listener at localhost/37745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@484e74fb rejected from java.util.concurrent.ThreadPoolExecutor@40b88444[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:46,995 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:46069-0x1005e14a3ec0002, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:46,995 ERROR [Listener at localhost/37745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30ebeae8 rejected from java.util.concurrent.ThreadPoolExecutor@40b88444[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:46,996 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@f1c9ed6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@f1c9ed6 2023-02-16 17:01:47,093 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:47,093 INFO [RS:0;jenkins-hbase4:33419] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33419,1676566903403; zookeeper connection closed. 2023-02-16 17:01:47,093 ERROR [Listener at localhost/37745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@9684978 rejected from java.util.concurrent.ThreadPoolExecutor@798fa312[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:47,093 DEBUG [Listener at localhost/37745-EventThread] zookeeper.ZKWatcher(600): regionserver:33419-0x1005e14a3ec0001, quorum=127.0.0.1:51006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:47,093 ERROR [Listener at localhost/37745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@bcad059 rejected from java.util.concurrent.ThreadPoolExecutor@798fa312[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:47,093 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@fc54320] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@fc54320 2023-02-16 17:01:47,094 INFO [Listener at localhost/37745] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 17:01:47,094 WARN [Listener at localhost/37745] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:47,097 INFO [Listener at localhost/37745] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:47,201 WARN [BP-626872764-172.31.14.131-1676566902753 heartbeating to localhost/127.0.0.1:40647] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 17:01:47,201 WARN [BP-626872764-172.31.14.131-1676566902753 heartbeating to localhost/127.0.0.1:40647] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-626872764-172.31.14.131-1676566902753 (Datanode Uuid f6198ebd-aaba-4992-aa0c-4760b634d64b) service to localhost/127.0.0.1:40647 2023-02-16 17:01:47,202 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/cluster_c746f4c8-5588-cbfc-185a-d7ae205d161f/dfs/data/data3/current/BP-626872764-172.31.14.131-1676566902753] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:47,202 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/cluster_c746f4c8-5588-cbfc-185a-d7ae205d161f/dfs/data/data4/current/BP-626872764-172.31.14.131-1676566902753] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:47,203 WARN [Listener at localhost/37745] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:47,221 INFO [Listener at localhost/37745] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:47,325 WARN [BP-626872764-172.31.14.131-1676566902753 heartbeating to localhost/127.0.0.1:40647] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 17:01:47,326 WARN [BP-626872764-172.31.14.131-1676566902753 heartbeating to localhost/127.0.0.1:40647] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-626872764-172.31.14.131-1676566902753 (Datanode Uuid 85202b67-afd4-45ae-820d-4278393abd77) service to localhost/127.0.0.1:40647 2023-02-16 17:01:47,327 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/cluster_c746f4c8-5588-cbfc-185a-d7ae205d161f/dfs/data/data1/current/BP-626872764-172.31.14.131-1676566902753] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:47,327 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/cluster_c746f4c8-5588-cbfc-185a-d7ae205d161f/dfs/data/data2/current/BP-626872764-172.31.14.131-1676566902753] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:47,337 INFO [Listener at localhost/37745] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:47,450 INFO [Listener at localhost/37745] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 17:01:47,466 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 17:01:47,478 INFO [Listener at localhost/37745] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=253 (was 227) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37745 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34685,1676566903353)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:40647 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40647 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:40647 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Listener at localhost/37745.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:40647 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:40647 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:40647 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:40647 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=658 (was 633) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=354 (was 350) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=1144 (was 1197) 2023-02-16 17:01:47,489 INFO [Listener at localhost/37745] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=253, OpenFileDescriptor=658, MaxFileDescriptor=60000, SystemLoadAverage=354, ProcessCount=170, AvailableMemoryMB=1144 2023-02-16 17:01:47,499 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/hadoop.log.dir so I do NOT create it in target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c 2023-02-16 17:01:47,500 WARN [Listener at localhost/37745] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 17:01:47,500 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/hadoop.tmp.dir so I do NOT create it in target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c 2023-02-16 17:01:47,500 WARN [Listener at localhost/37745] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c55612e-56c2-ddda-e411-8726b7a8aeb2/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 17:01:47,500 DEBUG [Listener at localhost/37745] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c 2023-02-16 17:01:47,500 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 17:01:47,500 INFO [Listener at localhost/37745] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/cluster_f3a54cdc-50d9-eb1b-b6c9-6d5231dab2b8, deleteOnExit=true 2023-02-16 17:01:47,500 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 17:01:47,500 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/test.cache.data in system properties and HBase conf 2023-02-16 17:01:47,500 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 17:01:47,501 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/hadoop.log.dir in system properties and HBase conf 2023-02-16 17:01:47,501 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 17:01:47,501 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 17:01:47,501 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 17:01:47,501 DEBUG [Listener at localhost/37745] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 17:01:47,501 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:01:47,502 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:01:47,502 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 17:01:47,502 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:01:47,502 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 17:01:47,502 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 17:01:47,503 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:01:47,503 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:01:47,503 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 17:01:47,503 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/nfs.dump.dir in system properties and HBase conf 2023-02-16 17:01:47,503 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/java.io.tmpdir in system properties and HBase conf 2023-02-16 17:01:47,503 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:01:47,503 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 17:01:47,504 INFO [Listener at localhost/37745] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 17:01:47,508 WARN [Listener at localhost/37745] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:01:47,509 WARN [Listener at localhost/37745] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:01:47,563 WARN [Listener at localhost/37745] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:47,567 INFO [Listener at localhost/37745] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:47,576 INFO [Listener at localhost/37745] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/java.io.tmpdir/Jetty_localhost_39931_hdfs____.pe6l9h/webapp 2023-02-16 17:01:47,686 INFO [Listener at localhost/37745] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39931 2023-02-16 17:01:47,691 WARN [Listener at localhost/37745] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:01:47,691 WARN [Listener at localhost/37745] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:01:47,733 WARN [Listener at localhost/44629] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:47,747 WARN [Listener at localhost/44629] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:47,752 WARN [Listener at localhost/44629] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:47,754 INFO [Listener at localhost/44629] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:47,759 INFO [Listener at localhost/44629] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/java.io.tmpdir/Jetty_localhost_36147_datanode____.vck6eg/webapp 2023-02-16 17:01:47,858 INFO [Listener at localhost/44629] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36147 2023-02-16 17:01:47,867 WARN [Listener at localhost/38485] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:47,880 WARN [Listener at localhost/38485] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:47,881 WARN [Listener at localhost/38485] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:47,882 INFO [Listener at localhost/38485] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:47,885 INFO [Listener at localhost/38485] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/java.io.tmpdir/Jetty_localhost_34299_datanode____tzobaw/webapp 2023-02-16 17:01:47,960 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x677cb8e5b0abf7f6: Processing first storage report for DS-7db0e3b6-9e82-4011-a718-9875448fe5bf from datanode ec0f4eb9-1e46-4809-86c0-9ce32d7ad414 2023-02-16 17:01:47,960 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x677cb8e5b0abf7f6: from storage DS-7db0e3b6-9e82-4011-a718-9875448fe5bf node DatanodeRegistration(127.0.0.1:46853, datanodeUuid=ec0f4eb9-1e46-4809-86c0-9ce32d7ad414, infoPort=41665, infoSecurePort=0, ipcPort=38485, storageInfo=lv=-57;cid=testClusterID;nsid=1995426861;c=1676566907511), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:47,960 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x677cb8e5b0abf7f6: Processing first storage report for DS-d361175c-0fa7-475a-b19b-0d39121754e5 from datanode ec0f4eb9-1e46-4809-86c0-9ce32d7ad414 2023-02-16 17:01:47,960 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x677cb8e5b0abf7f6: from storage DS-d361175c-0fa7-475a-b19b-0d39121754e5 node DatanodeRegistration(127.0.0.1:46853, datanodeUuid=ec0f4eb9-1e46-4809-86c0-9ce32d7ad414, infoPort=41665, infoSecurePort=0, ipcPort=38485, storageInfo=lv=-57;cid=testClusterID;nsid=1995426861;c=1676566907511), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:47,987 INFO [Listener at localhost/38485] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34299 2023-02-16 17:01:47,993 WARN [Listener at localhost/45745] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:48,088 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcb9f1d034b517d6b: Processing first storage report for DS-5c7da4d3-3329-48e5-b0e7-4c0dddf4e135 from datanode e0f05e52-9d37-4f61-a67f-57f041453035 2023-02-16 17:01:48,088 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcb9f1d034b517d6b: from storage DS-5c7da4d3-3329-48e5-b0e7-4c0dddf4e135 node DatanodeRegistration(127.0.0.1:39943, datanodeUuid=e0f05e52-9d37-4f61-a67f-57f041453035, infoPort=35373, infoSecurePort=0, ipcPort=45745, storageInfo=lv=-57;cid=testClusterID;nsid=1995426861;c=1676566907511), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:48,088 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcb9f1d034b517d6b: Processing first storage report for DS-14a85d1f-134f-419e-8c0c-9f170f15b1ee from datanode e0f05e52-9d37-4f61-a67f-57f041453035 2023-02-16 17:01:48,089 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcb9f1d034b517d6b: from storage DS-14a85d1f-134f-419e-8c0c-9f170f15b1ee node DatanodeRegistration(127.0.0.1:39943, datanodeUuid=e0f05e52-9d37-4f61-a67f-57f041453035, infoPort=35373, infoSecurePort=0, ipcPort=45745, storageInfo=lv=-57;cid=testClusterID;nsid=1995426861;c=1676566907511), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:48,101 DEBUG [Listener at localhost/45745] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c 2023-02-16 17:01:48,103 INFO [Listener at localhost/45745] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/cluster_f3a54cdc-50d9-eb1b-b6c9-6d5231dab2b8/zookeeper_0, clientPort=51888, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/cluster_f3a54cdc-50d9-eb1b-b6c9-6d5231dab2b8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/cluster_f3a54cdc-50d9-eb1b-b6c9-6d5231dab2b8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 17:01:48,104 INFO [Listener at localhost/45745] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51888 2023-02-16 17:01:48,104 INFO [Listener at localhost/45745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:48,105 INFO [Listener at localhost/45745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:48,118 INFO [Listener at localhost/45745] util.FSUtils(479): Created version file at hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76 with version=8 2023-02-16 17:01:48,118 INFO [Listener at localhost/45745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:48,119 INFO [Listener at localhost/45745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:48,120 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44629/user/jenkins/test-data/79ef287d-1e60-17af-0367-0eb54b39e87c/hbase-staging 2023-02-16 17:01:48,122 INFO [Listener at localhost/45745] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:48,122 INFO [Listener at localhost/45745] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:48,122 INFO [Listener at localhost/45745] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:48,122 INFO [Listener at localhost/45745] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:48,122 INFO [Listener at localhost/45745] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:48,122 INFO [Listener at localhost/45745] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:48,122 INFO [Listener at localhost/45745] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:48,123 INFO [Listener at localhost/45745] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41269 2023-02-16 17:01:48,124 INFO [Listener at localhost/45745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:48,125 INFO [Listener at localhost/45745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:48,125 INFO [Listener at localhost/45745] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41269 connecting to ZooKeeper ensemble=127.0.0.1:51888 2023-02-16 17:01:48,136 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:412690x0, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:48,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41269-0x1005e14b68c0000 connected 2023-02-16 17:01:48,151 DEBUG [Listener at localhost/45745] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:48,152 DEBUG [Listener at localhost/45745] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:48,152 DEBUG [Listener at localhost/45745] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:48,153 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41269 2023-02-16 17:01:48,153 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41269 2023-02-16 17:01:48,153 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41269 2023-02-16 17:01:48,165 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41269 2023-02-16 17:01:48,165 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41269 2023-02-16 17:01:48,165 INFO [Listener at localhost/45745] master.HMaster(444): hbase.rootdir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76, hbase.cluster.distributed=false 2023-02-16 17:01:48,179 INFO [Listener at localhost/45745] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:48,179 INFO [Listener at localhost/45745] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:48,179 INFO [Listener at localhost/45745] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:48,179 INFO [Listener at localhost/45745] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:48,179 INFO [Listener at localhost/45745] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:48,179 INFO [Listener at localhost/45745] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:48,179 INFO [Listener at localhost/45745] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:48,180 INFO [Listener at localhost/45745] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44173 2023-02-16 17:01:48,180 INFO [Listener at localhost/45745] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:48,181 DEBUG [Listener at localhost/45745] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:48,181 INFO [Listener at localhost/45745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:48,182 INFO [Listener at localhost/45745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:48,183 INFO [Listener at localhost/45745] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44173 connecting to ZooKeeper ensemble=127.0.0.1:51888 2023-02-16 17:01:48,186 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:441730x0, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:48,186 DEBUG [Listener at localhost/45745] zookeeper.ZKUtil(164): regionserver:441730x0, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:48,187 DEBUG [Listener at localhost/45745] zookeeper.ZKUtil(164): regionserver:441730x0, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:48,187 DEBUG [Listener at localhost/45745] zookeeper.ZKUtil(164): regionserver:441730x0, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:48,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44173-0x1005e14b68c0001 connected 2023-02-16 17:01:48,200 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44173 2023-02-16 17:01:48,200 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44173 2023-02-16 17:01:48,201 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44173 2023-02-16 17:01:48,204 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44173 2023-02-16 17:01:48,204 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44173 2023-02-16 17:01:48,216 INFO [Listener at localhost/45745] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:48,216 INFO [Listener at localhost/45745] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:48,217 INFO [Listener at localhost/45745] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:48,217 INFO [Listener at localhost/45745] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:48,217 INFO [Listener at localhost/45745] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:48,217 INFO [Listener at localhost/45745] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:48,217 INFO [Listener at localhost/45745] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:48,218 INFO [Listener at localhost/45745] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33401 2023-02-16 17:01:48,218 INFO [Listener at localhost/45745] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:48,219 DEBUG [Listener at localhost/45745] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:48,219 INFO [Listener at localhost/45745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:48,220 INFO [Listener at localhost/45745] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:48,221 INFO [Listener at localhost/45745] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33401 connecting to ZooKeeper ensemble=127.0.0.1:51888 2023-02-16 17:01:48,223 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:334010x0, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:48,224 DEBUG [Listener at localhost/45745] zookeeper.ZKUtil(164): regionserver:334010x0, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:48,224 DEBUG [Listener at localhost/45745] zookeeper.ZKUtil(164): regionserver:334010x0, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:48,225 DEBUG [Listener at localhost/45745] zookeeper.ZKUtil(164): regionserver:334010x0, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:48,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33401-0x1005e14b68c0002 connected 2023-02-16 17:01:48,233 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33401 2023-02-16 17:01:48,233 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33401 2023-02-16 17:01:48,234 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33401 2023-02-16 17:01:48,234 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33401 2023-02-16 17:01:48,235 DEBUG [Listener at localhost/45745] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33401 2023-02-16 17:01:48,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41269,1676566908121 2023-02-16 17:01:48,238 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:48,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41269,1676566908121 2023-02-16 17:01:48,240 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:48,240 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:48,240 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:48,240 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:48,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:48,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41269,1676566908121 from backup master directory 2023-02-16 17:01:48,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:48,244 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41269,1676566908121 2023-02-16 17:01:48,244 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:48,244 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:48,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41269,1676566908121 2023-02-16 17:01:48,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/hbase.id with ID: a2f9a28d-e36a-4634-aa1a-72103e43f06b 2023-02-16 17:01:48,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:48,263 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:48,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x154da66d to 127.0.0.1:51888 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:48,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f3c20ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:48,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:48,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 17:01:48,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:48,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/data/master/store-tmp 2023-02-16 17:01:48,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:48,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:48,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:48,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:48,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:48,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:48,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:48,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:48,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/WALs/jenkins-hbase4.apache.org,41269,1676566908121 2023-02-16 17:01:48,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41269%2C1676566908121, suffix=, logDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/WALs/jenkins-hbase4.apache.org,41269,1676566908121, archiveDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/oldWALs, maxLogs=10 2023-02-16 17:01:48,298 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46853,DS-7db0e3b6-9e82-4011-a718-9875448fe5bf,DISK] 2023-02-16 17:01:48,298 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39943,DS-5c7da4d3-3329-48e5-b0e7-4c0dddf4e135,DISK] 2023-02-16 17:01:48,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/WALs/jenkins-hbase4.apache.org,41269,1676566908121/jenkins-hbase4.apache.org%2C41269%2C1676566908121.1676566908286 2023-02-16 17:01:48,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46853,DS-7db0e3b6-9e82-4011-a718-9875448fe5bf,DISK], DatanodeInfoWithStorage[127.0.0.1:39943,DS-5c7da4d3-3329-48e5-b0e7-4c0dddf4e135,DISK]] 2023-02-16 17:01:48,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:48,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:48,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:48,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:48,301 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:48,302 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 17:01:48,302 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 17:01:48,303 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:48,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:48,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:48,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:48,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:48,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74512209, jitterRate=0.11031843721866608}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:48,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:48,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 17:01:48,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 17:01:48,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 17:01:48,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 17:01:48,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 17:01:48,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 17:01:48,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 17:01:48,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 17:01:48,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 17:01:48,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 17:01:48,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 17:01:48,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 17:01:48,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 17:01:48,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 17:01:48,324 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:48,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 17:01:48,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 17:01:48,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 17:01:48,326 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:48,326 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:48,326 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:48,326 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:48,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41269,1676566908121, sessionid=0x1005e14b68c0000, setting cluster-up flag (Was=false) 2023-02-16 17:01:48,331 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:48,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 17:01:48,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41269,1676566908121 2023-02-16 17:01:48,340 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:48,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 17:01:48,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41269,1676566908121 2023-02-16 17:01:48,344 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.hbase-snapshot/.tmp 2023-02-16 17:01:48,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:48,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:48,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:48,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:48,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:48,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 17:01:48,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:48,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676566938347 2023-02-16 17:01:48,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 17:01:48,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 17:01:48,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 17:01:48,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 17:01:48,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 17:01:48,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 17:01:48,348 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:48,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,348 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 17:01:48,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 17:01:48,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 17:01:48,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 17:01:48,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 17:01:48,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 17:01:48,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566908349,5,FailOnTimeoutGroup] 2023-02-16 17:01:48,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566908349,5,FailOnTimeoutGroup] 2023-02-16 17:01:48,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,349 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:48,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 17:01:48,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,356 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:48,356 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:48,356 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76 2023-02-16 17:01:48,362 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:48,362 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:48,363 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/info 2023-02-16 17:01:48,364 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:48,364 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:48,364 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:48,365 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:48,365 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:48,366 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:48,366 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:48,367 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/table 2023-02-16 17:01:48,367 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:48,367 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:48,368 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740 2023-02-16 17:01:48,368 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740 2023-02-16 17:01:48,369 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:48,370 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:48,372 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:48,372 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68178724, jitterRate=0.015942156314849854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:48,372 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:48,372 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:48,373 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:48,373 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:48,373 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:48,373 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:48,373 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:48,373 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:48,373 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:48,373 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 17:01:48,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 17:01:48,375 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 17:01:48,376 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 17:01:48,437 INFO [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(952): ClusterId : a2f9a28d-e36a-4634-aa1a-72103e43f06b 2023-02-16 17:01:48,437 INFO [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(952): ClusterId : a2f9a28d-e36a-4634-aa1a-72103e43f06b 2023-02-16 17:01:48,437 DEBUG [RS:1;jenkins-hbase4:33401] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:48,437 DEBUG [RS:0;jenkins-hbase4:44173] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:48,440 DEBUG [RS:0;jenkins-hbase4:44173] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:48,440 DEBUG [RS:0;jenkins-hbase4:44173] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:48,440 DEBUG [RS:1;jenkins-hbase4:33401] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:48,440 DEBUG [RS:1;jenkins-hbase4:33401] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:48,442 DEBUG [RS:0;jenkins-hbase4:44173] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:48,443 DEBUG [RS:0;jenkins-hbase4:44173] zookeeper.ReadOnlyZKClient(139): Connect 0x3f4e8a28 to 127.0.0.1:51888 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:48,443 DEBUG [RS:1;jenkins-hbase4:33401] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:48,443 DEBUG [RS:1;jenkins-hbase4:33401] zookeeper.ReadOnlyZKClient(139): Connect 0x7a457828 to 127.0.0.1:51888 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:48,448 DEBUG [RS:0;jenkins-hbase4:44173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@318963b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:48,448 DEBUG [RS:0;jenkins-hbase4:44173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35b6e158, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:48,448 DEBUG [RS:1;jenkins-hbase4:33401] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74829910, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:48,448 DEBUG [RS:1;jenkins-hbase4:33401] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70bd1358, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:48,456 DEBUG [RS:0;jenkins-hbase4:44173] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44173 2023-02-16 17:01:48,456 DEBUG [RS:1;jenkins-hbase4:33401] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33401 2023-02-16 17:01:48,457 INFO [RS:0;jenkins-hbase4:44173] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:48,457 INFO [RS:0;jenkins-hbase4:44173] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:48,457 INFO [RS:1;jenkins-hbase4:33401] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:48,457 INFO [RS:1;jenkins-hbase4:33401] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:48,457 DEBUG [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:48,457 DEBUG [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:48,457 INFO [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41269,1676566908121 with isa=jenkins-hbase4.apache.org/172.31.14.131:33401, startcode=1676566908216 2023-02-16 17:01:48,457 INFO [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41269,1676566908121 with isa=jenkins-hbase4.apache.org/172.31.14.131:44173, startcode=1676566908178 2023-02-16 17:01:48,457 DEBUG [RS:1;jenkins-hbase4:33401] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:48,457 DEBUG [RS:0;jenkins-hbase4:44173] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:48,459 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48079, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:48,459 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57887, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:48,460 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41269] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:48,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:48,461 DEBUG [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76 2023-02-16 17:01:48,461 DEBUG [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76 2023-02-16 17:01:48,461 DEBUG [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44629 2023-02-16 17:01:48,461 DEBUG [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44629 2023-02-16 17:01:48,461 DEBUG [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:48,461 DEBUG [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:48,462 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:48,465 DEBUG [RS:0;jenkins-hbase4:44173] zookeeper.ZKUtil(162): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:48,466 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33401,1676566908216] 2023-02-16 17:01:48,466 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44173,1676566908178] 2023-02-16 17:01:48,466 WARN [RS:0;jenkins-hbase4:44173] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:48,466 INFO [RS:0;jenkins-hbase4:44173] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:48,466 DEBUG [RS:1;jenkins-hbase4:33401] zookeeper.ZKUtil(162): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:48,466 DEBUG [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/WALs/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:48,466 WARN [RS:1;jenkins-hbase4:33401] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:48,466 INFO [RS:1;jenkins-hbase4:33401] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:48,466 DEBUG [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/WALs/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:48,470 DEBUG [RS:0;jenkins-hbase4:44173] zookeeper.ZKUtil(162): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:48,470 DEBUG [RS:1;jenkins-hbase4:33401] zookeeper.ZKUtil(162): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:48,470 DEBUG [RS:0;jenkins-hbase4:44173] zookeeper.ZKUtil(162): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:48,470 DEBUG [RS:1;jenkins-hbase4:33401] zookeeper.ZKUtil(162): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:48,471 DEBUG [RS:0;jenkins-hbase4:44173] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:48,471 DEBUG [RS:1;jenkins-hbase4:33401] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:48,471 INFO [RS:0;jenkins-hbase4:44173] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:48,471 INFO [RS:1;jenkins-hbase4:33401] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:48,472 INFO [RS:0;jenkins-hbase4:44173] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:48,472 INFO [RS:0;jenkins-hbase4:44173] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:48,472 INFO [RS:0;jenkins-hbase4:44173] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,475 INFO [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:48,480 INFO [RS:1;jenkins-hbase4:33401] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:48,480 INFO [RS:1;jenkins-hbase4:33401] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:48,480 INFO [RS:1;jenkins-hbase4:33401] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,481 INFO [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:48,481 INFO [RS:0;jenkins-hbase4:44173] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,481 DEBUG [RS:0;jenkins-hbase4:44173] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,481 DEBUG [RS:0;jenkins-hbase4:44173] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,481 DEBUG [RS:0;jenkins-hbase4:44173] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,481 DEBUG [RS:0;jenkins-hbase4:44173] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,482 DEBUG [RS:0;jenkins-hbase4:44173] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,482 DEBUG [RS:0;jenkins-hbase4:44173] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:48,482 DEBUG [RS:0;jenkins-hbase4:44173] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,482 DEBUG [RS:0;jenkins-hbase4:44173] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,482 DEBUG [RS:0;jenkins-hbase4:44173] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,482 DEBUG [RS:0;jenkins-hbase4:44173] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,482 INFO [RS:1;jenkins-hbase4:33401] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,484 DEBUG [RS:1;jenkins-hbase4:33401] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,484 DEBUG [RS:1;jenkins-hbase4:33401] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,486 INFO [RS:0;jenkins-hbase4:44173] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,486 DEBUG [RS:1;jenkins-hbase4:33401] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,486 INFO [RS:0;jenkins-hbase4:44173] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,486 DEBUG [RS:1;jenkins-hbase4:33401] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,486 INFO [RS:0;jenkins-hbase4:44173] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,486 DEBUG [RS:1;jenkins-hbase4:33401] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,487 DEBUG [RS:1;jenkins-hbase4:33401] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:48,487 DEBUG [RS:1;jenkins-hbase4:33401] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,487 DEBUG [RS:1;jenkins-hbase4:33401] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,487 DEBUG [RS:1;jenkins-hbase4:33401] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,487 DEBUG [RS:1;jenkins-hbase4:33401] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:48,488 INFO [RS:1;jenkins-hbase4:33401] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,488 INFO [RS:1;jenkins-hbase4:33401] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,488 INFO [RS:1;jenkins-hbase4:33401] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,498 INFO [RS:0;jenkins-hbase4:44173] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:48,499 INFO [RS:0;jenkins-hbase4:44173] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44173,1676566908178-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,501 INFO [RS:1;jenkins-hbase4:33401] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:48,501 INFO [RS:1;jenkins-hbase4:33401] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33401,1676566908216-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,510 INFO [RS:0;jenkins-hbase4:44173] regionserver.Replication(203): jenkins-hbase4.apache.org,44173,1676566908178 started 2023-02-16 17:01:48,510 INFO [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44173,1676566908178, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44173, sessionid=0x1005e14b68c0001 2023-02-16 17:01:48,510 DEBUG [RS:0;jenkins-hbase4:44173] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:48,510 DEBUG [RS:0;jenkins-hbase4:44173] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:48,510 DEBUG [RS:0;jenkins-hbase4:44173] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44173,1676566908178' 2023-02-16 17:01:48,510 DEBUG [RS:0;jenkins-hbase4:44173] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:48,511 DEBUG [RS:0;jenkins-hbase4:44173] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:48,511 DEBUG [RS:0;jenkins-hbase4:44173] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:48,511 DEBUG [RS:0;jenkins-hbase4:44173] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:48,511 DEBUG [RS:0;jenkins-hbase4:44173] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:48,511 DEBUG [RS:0;jenkins-hbase4:44173] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44173,1676566908178' 2023-02-16 17:01:48,511 DEBUG [RS:0;jenkins-hbase4:44173] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:48,512 DEBUG [RS:0;jenkins-hbase4:44173] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:48,512 DEBUG [RS:0;jenkins-hbase4:44173] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:48,512 INFO [RS:0;jenkins-hbase4:44173] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:48,512 INFO [RS:0;jenkins-hbase4:44173] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:48,519 INFO [RS:1;jenkins-hbase4:33401] regionserver.Replication(203): jenkins-hbase4.apache.org,33401,1676566908216 started 2023-02-16 17:01:48,519 INFO [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33401,1676566908216, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33401, sessionid=0x1005e14b68c0002 2023-02-16 17:01:48,519 DEBUG [RS:1;jenkins-hbase4:33401] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:48,519 DEBUG [RS:1;jenkins-hbase4:33401] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:48,519 DEBUG [RS:1;jenkins-hbase4:33401] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33401,1676566908216' 2023-02-16 17:01:48,519 DEBUG [RS:1;jenkins-hbase4:33401] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:48,520 DEBUG [RS:1;jenkins-hbase4:33401] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:48,520 DEBUG [RS:1;jenkins-hbase4:33401] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:48,520 DEBUG [RS:1;jenkins-hbase4:33401] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:48,520 DEBUG [RS:1;jenkins-hbase4:33401] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:48,520 DEBUG [RS:1;jenkins-hbase4:33401] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33401,1676566908216' 2023-02-16 17:01:48,520 DEBUG [RS:1;jenkins-hbase4:33401] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:48,521 DEBUG [RS:1;jenkins-hbase4:33401] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:48,521 DEBUG [RS:1;jenkins-hbase4:33401] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:48,521 INFO [RS:1;jenkins-hbase4:33401] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:48,521 INFO [RS:1;jenkins-hbase4:33401] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:48,526 DEBUG [jenkins-hbase4:41269] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 17:01:48,527 DEBUG [jenkins-hbase4:41269] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:48,528 DEBUG [jenkins-hbase4:41269] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:48,528 DEBUG [jenkins-hbase4:41269] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:48,528 DEBUG [jenkins-hbase4:41269] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:48,528 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33401,1676566908216, state=OPENING 2023-02-16 17:01:48,529 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 17:01:48,530 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:48,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33401,1676566908216}] 2023-02-16 17:01:48,530 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:48,685 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:48,685 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:48,686 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38474, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:48,690 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 17:01:48,690 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:48,691 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33401%2C1676566908216.meta, suffix=.meta, logDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/WALs/jenkins-hbase4.apache.org,33401,1676566908216, archiveDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/oldWALs, maxLogs=32 2023-02-16 17:01:48,704 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39943,DS-5c7da4d3-3329-48e5-b0e7-4c0dddf4e135,DISK] 2023-02-16 17:01:48,704 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46853,DS-7db0e3b6-9e82-4011-a718-9875448fe5bf,DISK] 2023-02-16 17:01:48,705 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/WALs/jenkins-hbase4.apache.org,33401,1676566908216/jenkins-hbase4.apache.org%2C33401%2C1676566908216.meta.1676566908691.meta 2023-02-16 17:01:48,705 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39943,DS-5c7da4d3-3329-48e5-b0e7-4c0dddf4e135,DISK], DatanodeInfoWithStorage[127.0.0.1:46853,DS-7db0e3b6-9e82-4011-a718-9875448fe5bf,DISK]] 2023-02-16 17:01:48,706 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:48,706 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 17:01:48,706 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 17:01:48,706 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 17:01:48,706 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 17:01:48,706 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:48,706 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 17:01:48,706 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 17:01:48,707 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:48,708 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/info 2023-02-16 17:01:48,708 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/info 2023-02-16 17:01:48,708 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:48,709 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:48,709 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:48,710 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:48,710 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:48,710 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:48,710 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:48,710 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:48,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/table 2023-02-16 17:01:48,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/table 2023-02-16 17:01:48,711 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:48,712 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:48,712 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740 2023-02-16 17:01:48,713 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740 2023-02-16 17:01:48,714 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:48,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:48,716 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66276837, jitterRate=-0.012398168444633484}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:48,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:48,716 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676566908685 2023-02-16 17:01:48,722 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 17:01:48,723 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 17:01:48,723 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33401,1676566908216, state=OPEN 2023-02-16 17:01:48,725 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 17:01:48,725 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:48,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 17:01:48,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33401,1676566908216 in 195 msec 2023-02-16 17:01:48,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 17:01:48,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-16 17:01:48,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 383 msec 2023-02-16 17:01:48,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676566908728, completionTime=-1 2023-02-16 17:01:48,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 17:01:48,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 17:01:48,730 DEBUG [hconnection-0x33be2c11-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:48,731 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38490, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:48,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 17:01:48,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676566968732 2023-02-16 17:01:48,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676567028732 2023-02-16 17:01:48,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-16 17:01:48,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41269,1676566908121-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41269,1676566908121-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41269,1676566908121-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41269, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:48,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 17:01:48,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:48,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 17:01:48,743 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 17:01:48,744 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:48,744 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:48,745 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0 2023-02-16 17:01:48,746 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0 empty. 2023-02-16 17:01:48,746 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0 2023-02-16 17:01:48,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 17:01:48,758 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:48,759 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4d24e276d8d23c19496e89591ffd22d0, NAME => 'hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp 2023-02-16 17:01:48,769 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:48,769 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4d24e276d8d23c19496e89591ffd22d0, disabling compactions & flushes 2023-02-16 17:01:48,769 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. 2023-02-16 17:01:48,769 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. 2023-02-16 17:01:48,769 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. after waiting 0 ms 2023-02-16 17:01:48,769 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. 2023-02-16 17:01:48,769 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. 2023-02-16 17:01:48,769 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4d24e276d8d23c19496e89591ffd22d0: 2023-02-16 17:01:48,771 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:48,772 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566908771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566908771"}]},"ts":"1676566908771"} 2023-02-16 17:01:48,773 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 17:01:48,774 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:48,774 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566908774"}]},"ts":"1676566908774"} 2023-02-16 17:01:48,775 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 17:01:48,779 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:48,779 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:48,779 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:48,779 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:48,780 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4d24e276d8d23c19496e89591ffd22d0, ASSIGN}] 2023-02-16 17:01:48,782 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4d24e276d8d23c19496e89591ffd22d0, ASSIGN 2023-02-16 17:01:48,783 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4d24e276d8d23c19496e89591ffd22d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44173,1676566908178; forceNewPlan=false, retain=false 2023-02-16 17:01:48,933 INFO [jenkins-hbase4:41269] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 17:01:48,933 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4d24e276d8d23c19496e89591ffd22d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:48,933 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566908933"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566908933"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566908933"}]},"ts":"1676566908933"} 2023-02-16 17:01:48,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4d24e276d8d23c19496e89591ffd22d0, server=jenkins-hbase4.apache.org,44173,1676566908178}] 2023-02-16 17:01:49,088 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:49,088 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:49,090 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50654, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:49,095 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. 2023-02-16 17:01:49,096 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44173%2C1676566908178, suffix=, logDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/WALs/jenkins-hbase4.apache.org,44173,1676566908178, archiveDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/oldWALs, maxLogs=32 2023-02-16 17:01:49,112 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39943,DS-5c7da4d3-3329-48e5-b0e7-4c0dddf4e135,DISK] 2023-02-16 17:01:49,112 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46853,DS-7db0e3b6-9e82-4011-a718-9875448fe5bf,DISK] 2023-02-16 17:01:49,114 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/WALs/jenkins-hbase4.apache.org,44173,1676566908178/jenkins-hbase4.apache.org%2C44173%2C1676566908178.1676566909097 2023-02-16 17:01:49,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46853,DS-7db0e3b6-9e82-4011-a718-9875448fe5bf,DISK], DatanodeInfoWithStorage[127.0.0.1:39943,DS-5c7da4d3-3329-48e5-b0e7-4c0dddf4e135,DISK]] 2023-02-16 17:01:49,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4d24e276d8d23c19496e89591ffd22d0, NAME => 'hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:49,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4d24e276d8d23c19496e89591ffd22d0 2023-02-16 17:01:49,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:49,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4d24e276d8d23c19496e89591ffd22d0 2023-02-16 17:01:49,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4d24e276d8d23c19496e89591ffd22d0 2023-02-16 17:01:49,116 INFO [StoreOpener-4d24e276d8d23c19496e89591ffd22d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4d24e276d8d23c19496e89591ffd22d0 2023-02-16 17:01:49,117 DEBUG [StoreOpener-4d24e276d8d23c19496e89591ffd22d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0/info 2023-02-16 17:01:49,117 DEBUG [StoreOpener-4d24e276d8d23c19496e89591ffd22d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0/info 2023-02-16 17:01:49,117 INFO [StoreOpener-4d24e276d8d23c19496e89591ffd22d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d24e276d8d23c19496e89591ffd22d0 columnFamilyName info 2023-02-16 17:01:49,117 INFO [StoreOpener-4d24e276d8d23c19496e89591ffd22d0-1] regionserver.HStore(310): Store=4d24e276d8d23c19496e89591ffd22d0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:49,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0 2023-02-16 17:01:49,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0 2023-02-16 17:01:49,120 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4d24e276d8d23c19496e89591ffd22d0 2023-02-16 17:01:49,121 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:49,122 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4d24e276d8d23c19496e89591ffd22d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68297050, jitterRate=0.01770535111427307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:49,122 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4d24e276d8d23c19496e89591ffd22d0: 2023-02-16 17:01:49,122 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0., pid=6, masterSystemTime=1676566909088 2023-02-16 17:01:49,124 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. 2023-02-16 17:01:49,124 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. 2023-02-16 17:01:49,125 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4d24e276d8d23c19496e89591ffd22d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:49,125 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566909125"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566909125"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566909125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566909125"}]},"ts":"1676566909125"} 2023-02-16 17:01:49,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 17:01:49,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4d24e276d8d23c19496e89591ffd22d0, server=jenkins-hbase4.apache.org,44173,1676566908178 in 191 msec 2023-02-16 17:01:49,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 17:01:49,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4d24e276d8d23c19496e89591ffd22d0, ASSIGN in 347 msec 2023-02-16 17:01:49,129 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:49,129 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566909129"}]},"ts":"1676566909129"} 2023-02-16 17:01:49,130 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 17:01:49,132 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:49,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 390 msec 2023-02-16 17:01:49,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 17:01:49,144 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:49,144 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:49,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:49,147 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50662, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:49,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 17:01:49,154 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:49,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-16 17:01:49,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 17:01:49,165 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:49,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-16 17:01:49,174 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 17:01:49,175 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 17:01:49,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.930sec 2023-02-16 17:01:49,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 17:01:49,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 17:01:49,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 17:01:49,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41269,1676566908121-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 17:01:49,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41269,1676566908121-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 17:01:49,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 17:01:49,237 DEBUG [Listener at localhost/45745] zookeeper.ReadOnlyZKClient(139): Connect 0x478466da to 127.0.0.1:51888 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:49,240 DEBUG [Listener at localhost/45745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e634876, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:49,241 DEBUG [hconnection-0x1b5e52d9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:49,242 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38494, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:49,244 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41269,1676566908121 2023-02-16 17:01:49,244 DEBUG [Listener at localhost/45745] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 17:01:49,246 DEBUG [Listener at localhost/45745] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 17:01:49,248 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60104, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 17:01:49,249 INFO [Listener at localhost/45745] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:49,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:49,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 17:01:49,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:60104 deadline: 1676566969249, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:49,250 INFO [Listener at localhost/45745] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 17:01:49,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:49,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:49,255 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:49,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-16 17:01:49,256 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:49,258 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:49,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:49,258 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7 empty. 2023-02-16 17:01:49,259 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:49,259 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-16 17:01:49,279 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:49,280 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 139fb11721187baa5ec99d05e9f528d7, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp 2023-02-16 17:01:49,294 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:49,295 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 139fb11721187baa5ec99d05e9f528d7, disabling compactions & flushes 2023-02-16 17:01:49,295 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:49,295 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:49,295 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. after waiting 0 ms 2023-02-16 17:01:49,295 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:49,295 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:49,295 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 139fb11721187baa5ec99d05e9f528d7: 2023-02-16 17:01:49,297 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:49,299 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676566909298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566909298"}]},"ts":"1676566909298"} 2023-02-16 17:01:49,301 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 17:01:49,301 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:49,302 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566909302"}]},"ts":"1676566909302"} 2023-02-16 17:01:49,303 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-16 17:01:49,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:49,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:49,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:49,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:49,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=139fb11721187baa5ec99d05e9f528d7, ASSIGN}] 2023-02-16 17:01:49,311 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=139fb11721187baa5ec99d05e9f528d7, ASSIGN 2023-02-16 17:01:49,315 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=139fb11721187baa5ec99d05e9f528d7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44173,1676566908178; forceNewPlan=false, retain=false 2023-02-16 17:01:49,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:49,465 INFO [jenkins-hbase4:41269] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 17:01:49,466 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=139fb11721187baa5ec99d05e9f528d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:49,466 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676566909466"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566909466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566909466"}]},"ts":"1676566909466"} 2023-02-16 17:01:49,467 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 139fb11721187baa5ec99d05e9f528d7, server=jenkins-hbase4.apache.org,44173,1676566908178}] 2023-02-16 17:01:49,522 INFO [RS:1;jenkins-hbase4:33401] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33401%2C1676566908216, suffix=, logDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/WALs/jenkins-hbase4.apache.org,33401,1676566908216, archiveDir=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/oldWALs, maxLogs=32 2023-02-16 17:01:49,537 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39943,DS-5c7da4d3-3329-48e5-b0e7-4c0dddf4e135,DISK] 2023-02-16 17:01:49,537 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46853,DS-7db0e3b6-9e82-4011-a718-9875448fe5bf,DISK] 2023-02-16 17:01:49,538 INFO [RS:1;jenkins-hbase4:33401] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/WALs/jenkins-hbase4.apache.org,33401,1676566908216/jenkins-hbase4.apache.org%2C33401%2C1676566908216.1676566909523 2023-02-16 17:01:49,543 DEBUG [RS:1;jenkins-hbase4:33401] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39943,DS-5c7da4d3-3329-48e5-b0e7-4c0dddf4e135,DISK], DatanodeInfoWithStorage[127.0.0.1:46853,DS-7db0e3b6-9e82-4011-a718-9875448fe5bf,DISK]] 2023-02-16 17:01:49,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:49,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:49,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 139fb11721187baa5ec99d05e9f528d7, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:49,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:49,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:49,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:49,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:49,624 INFO [StoreOpener-139fb11721187baa5ec99d05e9f528d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:49,625 DEBUG [StoreOpener-139fb11721187baa5ec99d05e9f528d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1 2023-02-16 17:01:49,625 DEBUG [StoreOpener-139fb11721187baa5ec99d05e9f528d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1 2023-02-16 17:01:49,626 INFO [StoreOpener-139fb11721187baa5ec99d05e9f528d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 139fb11721187baa5ec99d05e9f528d7 columnFamilyName f1 2023-02-16 17:01:49,626 INFO [StoreOpener-139fb11721187baa5ec99d05e9f528d7-1] regionserver.HStore(310): Store=139fb11721187baa5ec99d05e9f528d7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:49,626 INFO [StoreOpener-139fb11721187baa5ec99d05e9f528d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:49,627 DEBUG [StoreOpener-139fb11721187baa5ec99d05e9f528d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2 2023-02-16 17:01:49,627 DEBUG [StoreOpener-139fb11721187baa5ec99d05e9f528d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2 2023-02-16 17:01:49,628 INFO [StoreOpener-139fb11721187baa5ec99d05e9f528d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 139fb11721187baa5ec99d05e9f528d7 columnFamilyName f2 2023-02-16 17:01:49,628 INFO [StoreOpener-139fb11721187baa5ec99d05e9f528d7-1] regionserver.HStore(310): Store=139fb11721187baa5ec99d05e9f528d7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:49,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:49,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:49,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:49,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:49,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:49,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 139fb11721187baa5ec99d05e9f528d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73087681, jitterRate=0.08909131586551666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:49,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 139fb11721187baa5ec99d05e9f528d7: 2023-02-16 17:01:49,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7., pid=12, masterSystemTime=1676566909619 2023-02-16 17:01:49,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:49,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:49,637 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=139fb11721187baa5ec99d05e9f528d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:49,637 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676566909637"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566909637"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566909637"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566909637"}]},"ts":"1676566909637"} 2023-02-16 17:01:49,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 17:01:49,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 139fb11721187baa5ec99d05e9f528d7, server=jenkins-hbase4.apache.org,44173,1676566908178 in 172 msec 2023-02-16 17:01:49,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 17:01:49,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=139fb11721187baa5ec99d05e9f528d7, ASSIGN in 331 msec 2023-02-16 17:01:49,642 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:49,642 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566909642"}]},"ts":"1676566909642"} 2023-02-16 17:01:49,650 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-16 17:01:49,652 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:49,654 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 400 msec 2023-02-16 17:01:49,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:49,862 INFO [Listener at localhost/45745] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-16 17:01:49,862 DEBUG [Listener at localhost/45745] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-16 17:01:49,862 INFO [Listener at localhost/45745] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:49,864 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-16 17:01:49,864 INFO [Listener at localhost/45745] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:49,865 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-16 17:01:49,865 INFO [Listener at localhost/45745] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 17:01:49,879 DEBUG [hconnection-0x1b5e52d9-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:49,891 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50670, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:49,897 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44173] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:49,978 INFO [Listener at localhost/45745] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 17:01:49,978 INFO [Listener at localhost/45745] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 17:01:49,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 17:01:49,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676566909979 (current time:1676566909979). 2023-02-16 17:01:49,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 17:01:49,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(139): Connect 0x0bf74d48 to 127.0.0.1:51888 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:49,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c9329ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:49,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:49,985 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38506, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:49,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bf74d48 to 127.0.0.1:51888 2023-02-16 17:01:49,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:49,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 17:01:49,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 17:01:49,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 17:01:49,989 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 17:01:49,990 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676567509990 2023-02-16 17:01:49,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-16 17:01:49,990 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:49,991 DEBUG [Listener at localhost/45745] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:49,991 DEBUG [Listener at localhost/45745] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 17:01:49,992 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-16 17:01:49,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 17:01:49,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-16 17:01:49,993 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 17:01:49,994 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676567509994 2023-02-16 17:01:50,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-16 17:01:50,001 INFO [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-16 17:01:50,001 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:50,001 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-16 17:01:50,001 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-16 17:01:50,002 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,002 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-16 17:01:50,004 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:50,004 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:50,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:50,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:50,004 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:50,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:50,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 17:01:50,004 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,004 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-16 17:01:50,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-16 17:01:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 17:01:50,005 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-16 17:01:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-16 17:01:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-16 17:01:50,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 17:01:50,005 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-16 17:01:50,005 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 17:01:50,005 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 17:01:50,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-16 17:01:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 17:01:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33401,1676566908216' joining acquired barrier for procedure (foo) in zk 2023-02-16 17:01:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-16 17:01:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-16 17:01:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-16 17:01:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44173,1676566908178' joining acquired barrier for procedure (foo) in zk 2023-02-16 17:01:50,009 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,010 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,010 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:50,010 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,010 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:50,010 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,010 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 17:01:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:50,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44173,1676566908178' joining acquired barrier for procedure 'foo' on coordinator 2023-02-16 17:01:50,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b7a2e96[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:50,012 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-16 17:01:50,012 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,013 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,013 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,013 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 17:01:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,013 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 17:01:50,013 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 17:01:50,013 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,013 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-16 17:01:50,013 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. started... 2023-02-16 17:01:50,013 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 17:01:50,013 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,014 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:50,014 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,33401,1676566908216' in zk 2023-02-16 17:01:50,014 INFO [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 139fb11721187baa5ec99d05e9f528d7 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 17:01:50,016 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 17:01:50,016 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:50,016 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 17:01:50,029 INFO [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/.tmp/f1/970f42dc02ce4b6baba82f309717112f 2023-02-16 17:01:50,057 INFO [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/.tmp/f2/97eaad6a55294650b38210470e72810f 2023-02-16 17:01:50,063 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/.tmp/f1/970f42dc02ce4b6baba82f309717112f as hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1/970f42dc02ce4b6baba82f309717112f 2023-02-16 17:01:50,067 INFO [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1/970f42dc02ce4b6baba82f309717112f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 17:01:50,068 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/.tmp/f2/97eaad6a55294650b38210470e72810f as hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2/97eaad6a55294650b38210470e72810f 2023-02-16 17:01:50,073 INFO [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2/97eaad6a55294650b38210470e72810f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 17:01:50,074 INFO [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 139fb11721187baa5ec99d05e9f528d7 in 59ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:50,074 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 17:01:50,074 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 139fb11721187baa5ec99d05e9f528d7: 2023-02-16 17:01:50,074 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.' region-info for snapshot=foo 2023-02-16 17:01:50,075 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:50,075 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1/970f42dc02ce4b6baba82f309717112f] hfiles 2023-02-16 17:01:50,075 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1/970f42dc02ce4b6baba82f309717112f for snapshot=foo 2023-02-16 17:01:50,075 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2/97eaad6a55294650b38210470e72810f] hfiles 2023-02-16 17:01:50,075 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2/97eaad6a55294650b38210470e72810f for snapshot=foo 2023-02-16 17:01:50,085 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. completed. 2023-02-16 17:01:50,085 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,085 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 17:01:50,085 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 17:01:50,085 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,085 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-16 17:01:50,085 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,44173,1676566908178' in zk 2023-02-16 17:01:50,088 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,089 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-16 17:01:50,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:50,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:50,089 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:50,089 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-16 17:01:50,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:50,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:50,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 17:01:50,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:50,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 17:01:50,092 DEBUG [Listener at localhost/45745] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:50,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-16 17:01:50,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:50,093 DEBUG [Listener at localhost/45745] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 17:01:50,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,44173,1676566908178': 2023-02-16 17:01:50,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44173,1676566908178' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-16 17:01:50,094 INFO [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-16 17:01:50,094 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:50,094 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:50,094 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-16 17:01:50,094 INFO [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 17:01:50,095 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,095 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,095 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:50,095 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:50,095 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:50,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:50,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:50,096 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 17:01:50,097 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:50,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 17:01:50,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,098 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:50,098 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-16 17:01:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,105 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,105 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:50,105 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:50,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:50,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:50,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:50,105 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-16 17:01:50,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:50,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-16 17:01:50,105 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:50,105 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:50,105 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:50,105 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 17:01:50,106 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,106 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-16 17:01:50,106 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,106 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,106 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,106 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-16 17:01:50,106 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-16 17:01:50,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:50,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:50,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.hbase-snapshot/.tmp/foo 2023-02-16 17:01:50,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:50,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:50,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.hbase-snapshot/.tmp/foo to hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.hbase-snapshot/foo 2023-02-16 17:01:50,138 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-16 17:01:50,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.hbase-snapshot/.tmp/foo 2023-02-16 17:01:50,138 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.hbase-snapshot/.tmp/foo 2023-02-16 17:01:50,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676566909990Consolidate snapshot: foo at 1676566910105 (+115 ms)Loading Region manifests for foo at 1676566910105Writing data manifest for foo at 1676566910108 (+3 ms)Verifying snapshot: foo at 1676566910118 (+10 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676566910138 (+20 ms) 2023-02-16 17:01:50,140 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-16 17:01:50,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 149 msec 2023-02-16 17:01:50,294 DEBUG [Listener at localhost/45745] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:50,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-16 17:01:50,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 17:01:50,295 INFO [Listener at localhost/45745] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 17:01:50,300 INFO [Listener at localhost/45745] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 17:01:50,306 INFO [Listener at localhost/45745] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 17:01:50,333 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44173] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,411 INFO [Listener at localhost/45745] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 17:01:50,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 17:01:50,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,418 INFO [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 17:01:50,418 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:50,419 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-16 17:01:50,419 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-16 17:01:50,419 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,419 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,420 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:50,420 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:50,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:50,420 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:50,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:50,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:50,421 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,421 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:50,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:50,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,421 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:50,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,422 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,424 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,424 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,424 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-16 17:01:50,424 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:50,425 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-16 17:01:50,425 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-16 17:01:50,425 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33401,1676566908216' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-16 17:01:50,425 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-16 17:01:50,425 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:50,426 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-16 17:01:50,426 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 17:01:50,426 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 17:01:50,426 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,426 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. started... 2023-02-16 17:01:50,426 INFO [rs(jenkins-hbase4.apache.org,44173,1676566908178)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 139fb11721187baa5ec99d05e9f528d7 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 17:01:50,427 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,427 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,427 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:50,441 INFO [rs(jenkins-hbase4.apache.org,44173,1676566908178)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/.tmp/f1/c5b3149d28034504989f96c1a0847f76 2023-02-16 17:01:50,459 INFO [rs(jenkins-hbase4.apache.org,44173,1676566908178)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/.tmp/f2/71311c47c5ce45c1a56860a9a617d603 2023-02-16 17:01:50,464 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/.tmp/f1/c5b3149d28034504989f96c1a0847f76 as hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1/c5b3149d28034504989f96c1a0847f76 2023-02-16 17:01:50,468 INFO [rs(jenkins-hbase4.apache.org,44173,1676566908178)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1/c5b3149d28034504989f96c1a0847f76, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 17:01:50,469 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/.tmp/f2/71311c47c5ce45c1a56860a9a617d603 as hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2/71311c47c5ce45c1a56860a9a617d603 2023-02-16 17:01:50,473 INFO [rs(jenkins-hbase4.apache.org,44173,1676566908178)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2/71311c47c5ce45c1a56860a9a617d603, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 17:01:50,474 INFO [rs(jenkins-hbase4.apache.org,44173,1676566908178)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 139fb11721187baa5ec99d05e9f528d7 in 48ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:50,475 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 139fb11721187baa5ec99d05e9f528d7: 2023-02-16 17:01:50,475 DEBUG [rs(jenkins-hbase4.apache.org,44173,1676566908178)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,475 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 17:01:50,475 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 17:01:50,475 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,475 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-16 17:01:50,476 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44173,1676566908178' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-16 17:01:50,477 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,477 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:50,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:50,478 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,478 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:50,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:50,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:50,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44173,1676566908178' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-16 17:01:50,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f45bb21[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:50,480 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-16 17:01:50,480 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,482 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,482 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,483 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,483 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:50,483 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-16 17:01:50,483 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-16 17:01:50,483 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-16 17:01:50,483 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,44173,1676566908178' in zk 2023-02-16 17:01:50,483 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-16 17:01:50,483 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,33401,1676566908216' in zk 2023-02-16 17:01:50,484 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-16 17:01:50,484 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,485 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:50,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,485 DEBUG [member: 'jenkins-hbase4.apache.org,44173,1676566908178' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-16 17:01:50,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:50,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:50,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:50,485 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-16 17:01:50,485 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:50,485 DEBUG [member: 'jenkins-hbase4.apache.org,33401,1676566908216' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-16 17:01:50,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,44173,1676566908178': 2023-02-16 17:01:50,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44173,1676566908178' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-16 17:01:50,488 INFO [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-16 17:01:50,488 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:50,488 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:50,488 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,488 INFO [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 17:01:50,489 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,490 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:50,490 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:50,490 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,490 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:50,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:50,490 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:50,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,491 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:50,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,492 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:50,493 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,497 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,497 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:50,497 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,497 DEBUG [(jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:50,497 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:50,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-16 17:01:50,497 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:50,497 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:50,497 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:50,497 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 17:01:50,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:50,497 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:50,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:50,497 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,498 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:50,498 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,498 DEBUG [Listener at localhost/45745] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:50,498 DEBUG [Listener at localhost/45745] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 17:01:50,498 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:50,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:50,598 DEBUG [Listener at localhost/45745] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 17:01:50,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 17:01:50,603 INFO [Listener at localhost/45745] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676566909979 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:50,603 DEBUG [Listener at localhost/45745] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44629/user/jenkins/test-data/79ef287d-1e60-17af-0367-0eb54b39e87c/foo/870914ec-e9a7-47d6-a44d-ce717121c630/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,603 INFO [Listener at localhost/45745] snapshot.RestoreSnapshotHelper(239): region to add: 139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:50,603 INFO [Listener at localhost/45745] snapshot.RestoreSnapshotHelper(585): clone region=139fb11721187baa5ec99d05e9f528d7 as 139fb11721187baa5ec99d05e9f528d7 in snapshot foo 2023-02-16 17:01:50,604 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 139fb11721187baa5ec99d05e9f528d7, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44629/user/jenkins/test-data/79ef287d-1e60-17af-0367-0eb54b39e87c/foo/870914ec-e9a7-47d6-a44d-ce717121c630 2023-02-16 17:01:50,610 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:50,610 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 970f42dc02ce4b6baba82f309717112f from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,611 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 97eaad6a55294650b38210470e72810f from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,613 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 139fb11721187baa5ec99d05e9f528d7, disabling compactions & flushes 2023-02-16 17:01:50,613 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,613 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,613 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. after waiting 0 ms 2023-02-16 17:01:50,613 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,613 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,613 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 139fb11721187baa5ec99d05e9f528d7: 2023-02-16 17:01:50,615 INFO [Listener at localhost/45745] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676566909979 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:50,615 DEBUG [Listener at localhost/45745] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44629/user/jenkins/test-data/79ef287d-1e60-17af-0367-0eb54b39e87c/foo/870914ec-e9a7-47d6-a44d-ce717121c630 2023-02-16 17:01:50,615 DEBUG [Listener at localhost/45745] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44629/user/jenkins/test-data/79ef287d-1e60-17af-0367-0eb54b39e87c/foo/870914ec-e9a7-47d6-a44d-ce717121c630 2023-02-16 17:01:50,616 DEBUG [Listener at localhost/45745] util.CommonFSUtils(699): |-data/ 2023-02-16 17:01:50,616 DEBUG [Listener at localhost/45745] util.CommonFSUtils(699): |----default/ 2023-02-16 17:01:50,616 DEBUG [Listener at localhost/45745] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-16 17:01:50,616 DEBUG [Listener at localhost/45745] util.CommonFSUtils(699): |----------139fb11721187baa5ec99d05e9f528d7/ 2023-02-16 17:01:50,617 DEBUG [Listener at localhost/45745] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:50,617 DEBUG [Listener at localhost/45745] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:50,617 DEBUG [Listener at localhost/45745] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=139fb11721187baa5ec99d05e9f528d7-970f42dc02ce4b6baba82f309717112f 2023-02-16 17:01:50,617 DEBUG [Listener at localhost/45745] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:50,617 DEBUG [Listener at localhost/45745] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=139fb11721187baa5ec99d05e9f528d7-97eaad6a55294650b38210470e72810f hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1/970f42dc02ce4b6baba82f309717112f hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1/c5b3149d28034504989f96c1a0847f76 hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2/71311c47c5ce45c1a56860a9a617d603 hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2/97eaad6a55294650b38210470e72810f 2023-02-16 17:01:50,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-16 17:01:50,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-16 17:01:50,628 INFO [Listener at localhost/45745] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,631 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566910631"}]},"ts":"1676566910631"} 2023-02-16 17:01:50,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 17:01:50,632 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-16 17:01:50,634 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-16 17:01:50,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=139fb11721187baa5ec99d05e9f528d7, UNASSIGN}] 2023-02-16 17:01:50,636 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=139fb11721187baa5ec99d05e9f528d7, UNASSIGN 2023-02-16 17:01:50,636 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=139fb11721187baa5ec99d05e9f528d7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:50,636 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676566910636"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566910636"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566910636"}]},"ts":"1676566910636"} 2023-02-16 17:01:50,638 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 139fb11721187baa5ec99d05e9f528d7, server=jenkins-hbase4.apache.org,44173,1676566908178}] 2023-02-16 17:01:50,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 17:01:50,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:50,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 139fb11721187baa5ec99d05e9f528d7, disabling compactions & flushes 2023-02-16 17:01:50,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. after waiting 0 ms 2023-02-16 17:01:50,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:50,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7. 2023-02-16 17:01:50,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 139fb11721187baa5ec99d05e9f528d7: 2023-02-16 17:01:50,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:50,796 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=139fb11721187baa5ec99d05e9f528d7, regionState=CLOSED 2023-02-16 17:01:50,796 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676566910796"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566910796"}]},"ts":"1676566910796"} 2023-02-16 17:01:50,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 17:01:50,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 139fb11721187baa5ec99d05e9f528d7, server=jenkins-hbase4.apache.org,44173,1676566908178 in 160 msec 2023-02-16 17:01:50,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 17:01:50,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=139fb11721187baa5ec99d05e9f528d7, UNASSIGN in 164 msec 2023-02-16 17:01:50,800 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566910800"}]},"ts":"1676566910800"} 2023-02-16 17:01:50,802 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-16 17:01:50,805 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-16 17:01:50,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 178 msec 2023-02-16 17:01:50,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 17:01:50,934 INFO [Listener at localhost/45745] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-16 17:01:50,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,938 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,938 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 17:01:50,941 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:50,942 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1, FileablePath, hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2, FileablePath, hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/recovered.edits] 2023-02-16 17:01:50,945 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1/970f42dc02ce4b6baba82f309717112f to hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1/970f42dc02ce4b6baba82f309717112f 2023-02-16 17:01:50,946 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1/c5b3149d28034504989f96c1a0847f76 to hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f1/c5b3149d28034504989f96c1a0847f76 2023-02-16 17:01:50,949 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2/71311c47c5ce45c1a56860a9a617d603 to hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2/71311c47c5ce45c1a56860a9a617d603 2023-02-16 17:01:50,950 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2/97eaad6a55294650b38210470e72810f to hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/f2/97eaad6a55294650b38210470e72810f 2023-02-16 17:01:50,952 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/recovered.edits/12.seqid to hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7/recovered.edits/12.seqid 2023-02-16 17:01:50,952 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/139fb11721187baa5ec99d05e9f528d7 2023-02-16 17:01:50,952 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-16 17:01:50,954 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,956 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-16 17:01:50,957 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-16 17:01:50,962 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,962 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-16 17:01:50,962 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566910962"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:50,964 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 17:01:50,964 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 139fb11721187baa5ec99d05e9f528d7, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676566909252.139fb11721187baa5ec99d05e9f528d7.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 17:01:50,964 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-16 17:01:50,964 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676566910964"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:50,965 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-16 17:01:50,967 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-16 17:01:50,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 32 msec 2023-02-16 17:01:51,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41269] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 17:01:51,040 INFO [Listener at localhost/45745] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-16 17:01:51,040 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 17:01:51,040 INFO [Listener at localhost/45745] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 17:01:51,041 DEBUG [Listener at localhost/45745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x478466da to 127.0.0.1:51888 2023-02-16 17:01:51,041 DEBUG [Listener at localhost/45745] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:51,041 DEBUG [Listener at localhost/45745] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 17:01:51,041 DEBUG [Listener at localhost/45745] util.JVMClusterUtil(257): Found active master hash=828031539, stopped=false 2023-02-16 17:01:51,041 INFO [Listener at localhost/45745] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41269,1676566908121 2023-02-16 17:01:51,044 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:51,044 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:51,044 INFO [Listener at localhost/45745] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 17:01:51,044 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:51,044 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:51,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:51,046 DEBUG [Listener at localhost/45745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x154da66d to 127.0.0.1:51888 2023-02-16 17:01:51,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:51,046 DEBUG [Listener at localhost/45745] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:51,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:51,046 INFO [Listener at localhost/45745] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44173,1676566908178' ***** 2023-02-16 17:01:51,046 INFO [Listener at localhost/45745] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:51,046 INFO [Listener at localhost/45745] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33401,1676566908216' ***** 2023-02-16 17:01:51,046 INFO [Listener at localhost/45745] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:51,046 INFO [RS:0;jenkins-hbase4:44173] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:51,046 INFO [RS:1;jenkins-hbase4:33401] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:51,046 INFO [RS:1;jenkins-hbase4:33401] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:51,046 INFO [RS:1;jenkins-hbase4:33401] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:51,047 INFO [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:51,047 DEBUG [RS:1;jenkins-hbase4:33401] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a457828 to 127.0.0.1:51888 2023-02-16 17:01:51,047 DEBUG [RS:1;jenkins-hbase4:33401] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:51,047 INFO [RS:1;jenkins-hbase4:33401] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:51,047 INFO [RS:1;jenkins-hbase4:33401] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:51,047 INFO [RS:1;jenkins-hbase4:33401] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:51,047 INFO [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 17:01:51,046 INFO [RS:0;jenkins-hbase4:44173] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:51,047 INFO [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 17:01:51,047 INFO [RS:0;jenkins-hbase4:44173] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:51,046 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:51,047 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:51,046 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:51,048 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:51,047 INFO [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(3304): Received CLOSE for 4d24e276d8d23c19496e89591ffd22d0 2023-02-16 17:01:51,047 DEBUG [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-16 17:01:51,049 INFO [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:51,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4d24e276d8d23c19496e89591ffd22d0, disabling compactions & flushes 2023-02-16 17:01:51,049 DEBUG [RS:0;jenkins-hbase4:44173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f4e8a28 to 127.0.0.1:51888 2023-02-16 17:01:51,049 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:51,049 DEBUG [RS:0;jenkins-hbase4:44173] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:51,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. 2023-02-16 17:01:51,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. 2023-02-16 17:01:51,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. after waiting 0 ms 2023-02-16 17:01:51,049 DEBUG [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-16 17:01:51,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. 2023-02-16 17:01:51,049 INFO [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-16 17:01:51,049 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:51,049 DEBUG [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(1479): Online Regions={4d24e276d8d23c19496e89591ffd22d0=hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0.} 2023-02-16 17:01:51,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4d24e276d8d23c19496e89591ffd22d0 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 17:01:51,049 DEBUG [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(1505): Waiting on 4d24e276d8d23c19496e89591ffd22d0 2023-02-16 17:01:51,049 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:51,050 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-16 17:01:51,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0/.tmp/info/2a4ba3d3a8d1431b9c30db3c90690765 2023-02-16 17:01:51,057 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/.tmp/info/4c1e948782ea4eb9b5c9cc9e42a6a95c 2023-02-16 17:01:51,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c1e948782ea4eb9b5c9cc9e42a6a95c 2023-02-16 17:01:51,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0/.tmp/info/2a4ba3d3a8d1431b9c30db3c90690765 as hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0/info/2a4ba3d3a8d1431b9c30db3c90690765 2023-02-16 17:01:51,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0/info/2a4ba3d3a8d1431b9c30db3c90690765, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 17:01:51,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4d24e276d8d23c19496e89591ffd22d0 in 17ms, sequenceid=6, compaction requested=false 2023-02-16 17:01:51,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-16 17:01:51,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/.tmp/rep_barrier/92c1f3c3b2a64e608e1c90a4656ca2d6 2023-02-16 17:01:51,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/namespace/4d24e276d8d23c19496e89591ffd22d0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 17:01:51,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. 2023-02-16 17:01:51,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4d24e276d8d23c19496e89591ffd22d0: 2023-02-16 17:01:51,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676566908742.4d24e276d8d23c19496e89591ffd22d0. 2023-02-16 17:01:51,071 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92c1f3c3b2a64e608e1c90a4656ca2d6 2023-02-16 17:01:51,077 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/.tmp/table/3bec02507a324745ba575c146a4abc39 2023-02-16 17:01:51,080 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bec02507a324745ba575c146a4abc39 2023-02-16 17:01:51,080 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/.tmp/info/4c1e948782ea4eb9b5c9cc9e42a6a95c as hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/info/4c1e948782ea4eb9b5c9cc9e42a6a95c 2023-02-16 17:01:51,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c1e948782ea4eb9b5c9cc9e42a6a95c 2023-02-16 17:01:51,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/info/4c1e948782ea4eb9b5c9cc9e42a6a95c, entries=12, sequenceid=21, filesize=6.3 K 2023-02-16 17:01:51,085 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/.tmp/rep_barrier/92c1f3c3b2a64e608e1c90a4656ca2d6 as hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/rep_barrier/92c1f3c3b2a64e608e1c90a4656ca2d6 2023-02-16 17:01:51,090 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:51,091 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92c1f3c3b2a64e608e1c90a4656ca2d6 2023-02-16 17:01:51,091 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/rep_barrier/92c1f3c3b2a64e608e1c90a4656ca2d6, entries=1, sequenceid=21, filesize=5.1 K 2023-02-16 17:01:51,092 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:51,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/.tmp/table/3bec02507a324745ba575c146a4abc39 as hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/table/3bec02507a324745ba575c146a4abc39 2023-02-16 17:01:51,097 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bec02507a324745ba575c146a4abc39 2023-02-16 17:01:51,097 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/table/3bec02507a324745ba575c146a4abc39, entries=4, sequenceid=21, filesize=5.1 K 2023-02-16 17:01:51,098 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false 2023-02-16 17:01:51,098 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-16 17:01:51,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 17:01:51,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 17:01:51,102 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:51,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:51,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:51,249 INFO [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33401,1676566908216; all regions closed. 2023-02-16 17:01:51,250 INFO [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44173,1676566908178; all regions closed. 2023-02-16 17:01:51,256 DEBUG [RS:1;jenkins-hbase4:33401] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/oldWALs 2023-02-16 17:01:51,256 INFO [RS:1;jenkins-hbase4:33401] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33401%2C1676566908216.meta:.meta(num 1676566908691) 2023-02-16 17:01:51,258 DEBUG [RS:0;jenkins-hbase4:44173] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/oldWALs 2023-02-16 17:01:51,258 INFO [RS:0;jenkins-hbase4:44173] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44173%2C1676566908178:(num 1676566909097) 2023-02-16 17:01:51,258 DEBUG [RS:0;jenkins-hbase4:44173] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:51,258 INFO [RS:0;jenkins-hbase4:44173] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:51,258 INFO [RS:0;jenkins-hbase4:44173] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:51,258 INFO [RS:0;jenkins-hbase4:44173] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:51,258 INFO [RS:0;jenkins-hbase4:44173] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:51,258 INFO [RS:0;jenkins-hbase4:44173] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:51,259 INFO [RS:0;jenkins-hbase4:44173] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44173 2023-02-16 17:01:51,260 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:51,262 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:51,262 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44173,1676566908178 2023-02-16 17:01:51,262 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:51,262 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:51,262 ERROR [Listener at localhost/45745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5bc4acff rejected from java.util.concurrent.ThreadPoolExecutor@5ffb235f[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:51,262 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:51,262 ERROR [Listener at localhost/45745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5574d784 rejected from java.util.concurrent.ThreadPoolExecutor@5ffb235f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:51,262 DEBUG [RS:1;jenkins-hbase4:33401] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/oldWALs 2023-02-16 17:01:51,262 INFO [RS:1;jenkins-hbase4:33401] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33401%2C1676566908216:(num 1676566909523) 2023-02-16 17:01:51,262 DEBUG [RS:1;jenkins-hbase4:33401] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:51,262 INFO [RS:1;jenkins-hbase4:33401] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:51,263 INFO [RS:1;jenkins-hbase4:33401] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:51,263 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:51,263 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44173,1676566908178] 2023-02-16 17:01:51,264 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44173,1676566908178; numProcessing=1 2023-02-16 17:01:51,264 INFO [RS:1;jenkins-hbase4:33401] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33401 2023-02-16 17:01:51,266 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44173,1676566908178 already deleted, retry=false 2023-02-16 17:01:51,266 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44173,1676566908178 expired; onlineServers=1 2023-02-16 17:01:51,268 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:51,268 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33401,1676566908216 2023-02-16 17:01:51,268 ERROR [Listener at localhost/45745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1cb65c64 rejected from java.util.concurrent.ThreadPoolExecutor@1889cb2a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:51,268 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33401,1676566908216] 2023-02-16 17:01:51,268 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33401,1676566908216; numProcessing=2 2023-02-16 17:01:51,270 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33401,1676566908216 already deleted, retry=false 2023-02-16 17:01:51,270 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33401,1676566908216 expired; onlineServers=0 2023-02-16 17:01:51,270 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41269,1676566908121' ***** 2023-02-16 17:01:51,270 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 17:01:51,271 DEBUG [M:0;jenkins-hbase4:41269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@356540c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:51,271 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41269,1676566908121 2023-02-16 17:01:51,271 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41269,1676566908121; all regions closed. 2023-02-16 17:01:51,271 DEBUG [M:0;jenkins-hbase4:41269] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:51,271 DEBUG [M:0;jenkins-hbase4:41269] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 17:01:51,271 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 17:01:51,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566908349] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566908349,5,FailOnTimeoutGroup] 2023-02-16 17:01:51,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566908349] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566908349,5,FailOnTimeoutGroup] 2023-02-16 17:01:51,271 DEBUG [M:0;jenkins-hbase4:41269] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 17:01:51,273 INFO [M:0;jenkins-hbase4:41269] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 17:01:51,273 INFO [M:0;jenkins-hbase4:41269] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 17:01:51,273 INFO [M:0;jenkins-hbase4:41269] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 17:01:51,273 DEBUG [M:0;jenkins-hbase4:41269] master.HMaster(1512): Stopping service threads 2023-02-16 17:01:51,273 INFO [M:0;jenkins-hbase4:41269] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 17:01:51,274 ERROR [M:0;jenkins-hbase4:41269] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 17:01:51,274 INFO [M:0;jenkins-hbase4:41269] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 17:01:51,274 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 17:01:51,275 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:51,275 DEBUG [M:0;jenkins-hbase4:41269] zookeeper.ZKUtil(398): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 17:01:51,275 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:51,275 WARN [M:0;jenkins-hbase4:41269] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 17:01:51,275 INFO [M:0;jenkins-hbase4:41269] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 17:01:51,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:51,276 INFO [M:0;jenkins-hbase4:41269] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 17:01:51,276 DEBUG [M:0;jenkins-hbase4:41269] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:51,276 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:51,276 DEBUG [M:0;jenkins-hbase4:41269] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:51,276 DEBUG [M:0;jenkins-hbase4:41269] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:51,276 DEBUG [M:0;jenkins-hbase4:41269] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:51,276 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.65 KB heapSize=67.61 KB 2023-02-16 17:01:51,286 INFO [M:0;jenkins-hbase4:41269] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.65 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/83be27bb3f7347cab22238f158b48b59 2023-02-16 17:01:51,291 DEBUG [M:0;jenkins-hbase4:41269] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/83be27bb3f7347cab22238f158b48b59 as hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/83be27bb3f7347cab22238f158b48b59 2023-02-16 17:01:51,295 INFO [M:0;jenkins-hbase4:41269] regionserver.HStore(1080): Added hdfs://localhost:44629/user/jenkins/test-data/35e20310-3bbc-48e2-24d8-ea46a880ab76/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/83be27bb3f7347cab22238f158b48b59, entries=17, sequenceid=132, filesize=8.7 K 2023-02-16 17:01:51,296 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegion(2947): Finished flush of dataSize ~56.65 KB/58009, heapSize ~67.59 KB/69216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=132, compaction requested=false 2023-02-16 17:01:51,297 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:51,297 DEBUG [M:0;jenkins-hbase4:41269] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:51,299 INFO [M:0;jenkins-hbase4:41269] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 17:01:51,299 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:51,300 INFO [M:0;jenkins-hbase4:41269] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41269 2023-02-16 17:01:51,303 DEBUG [M:0;jenkins-hbase4:41269] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41269,1676566908121 already deleted, retry=false 2023-02-16 17:01:51,546 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:51,546 INFO [M:0;jenkins-hbase4:41269] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41269,1676566908121; zookeeper connection closed. 2023-02-16 17:01:51,546 ERROR [Listener at localhost/45745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3d676c37 rejected from java.util.concurrent.ThreadPoolExecutor@3958ef43[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:51,547 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): master:41269-0x1005e14b68c0000, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:51,547 ERROR [Listener at localhost/45745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b6cf4a8 rejected from java.util.concurrent.ThreadPoolExecutor@3958ef43[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:51,646 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:51,646 INFO [RS:1;jenkins-hbase4:33401] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33401,1676566908216; zookeeper connection closed. 2023-02-16 17:01:51,646 ERROR [Listener at localhost/45745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@42674ec4 rejected from java.util.concurrent.ThreadPoolExecutor@1889cb2a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:51,646 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:33401-0x1005e14b68c0002, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:51,646 ERROR [Listener at localhost/45745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3a1a29a2 rejected from java.util.concurrent.ThreadPoolExecutor@1889cb2a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:51,646 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@722b0e2b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@722b0e2b 2023-02-16 17:01:51,746 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:51,746 INFO [RS:0;jenkins-hbase4:44173] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44173,1676566908178; zookeeper connection closed. 2023-02-16 17:01:51,746 ERROR [Listener at localhost/45745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2dce1570 rejected from java.util.concurrent.ThreadPoolExecutor@5ffb235f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:51,746 DEBUG [Listener at localhost/45745-EventThread] zookeeper.ZKWatcher(600): regionserver:44173-0x1005e14b68c0001, quorum=127.0.0.1:51888, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:51,746 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@65116948] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@65116948 2023-02-16 17:01:51,746 ERROR [Listener at localhost/45745-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@96d79a2 rejected from java.util.concurrent.ThreadPoolExecutor@5ffb235f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:51,747 INFO [Listener at localhost/45745] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 17:01:51,747 WARN [Listener at localhost/45745] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:51,752 INFO [Listener at localhost/45745] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:51,858 WARN [BP-180143791-172.31.14.131-1676566907511 heartbeating to localhost/127.0.0.1:44629] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 17:01:51,858 WARN [BP-180143791-172.31.14.131-1676566907511 heartbeating to localhost/127.0.0.1:44629] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-180143791-172.31.14.131-1676566907511 (Datanode Uuid e0f05e52-9d37-4f61-a67f-57f041453035) service to localhost/127.0.0.1:44629 2023-02-16 17:01:51,859 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/cluster_f3a54cdc-50d9-eb1b-b6c9-6d5231dab2b8/dfs/data/data3/current/BP-180143791-172.31.14.131-1676566907511] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:51,859 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/cluster_f3a54cdc-50d9-eb1b-b6c9-6d5231dab2b8/dfs/data/data4/current/BP-180143791-172.31.14.131-1676566907511] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:51,860 WARN [Listener at localhost/45745] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:51,869 INFO [Listener at localhost/45745] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:51,873 WARN [BP-180143791-172.31.14.131-1676566907511 heartbeating to localhost/127.0.0.1:44629] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 17:01:51,873 WARN [BP-180143791-172.31.14.131-1676566907511 heartbeating to localhost/127.0.0.1:44629] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-180143791-172.31.14.131-1676566907511 (Datanode Uuid ec0f4eb9-1e46-4809-86c0-9ce32d7ad414) service to localhost/127.0.0.1:44629 2023-02-16 17:01:51,873 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/cluster_f3a54cdc-50d9-eb1b-b6c9-6d5231dab2b8/dfs/data/data1/current/BP-180143791-172.31.14.131-1676566907511] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:51,874 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/cluster_f3a54cdc-50d9-eb1b-b6c9-6d5231dab2b8/dfs/data/data2/current/BP-180143791-172.31.14.131-1676566907511] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:51,883 INFO [Listener at localhost/45745] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:51,896 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 17:01:51,995 INFO [Listener at localhost/45745] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 17:01:52,011 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 17:01:52,025 INFO [Listener at localhost/45745] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=273 (was 253) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45745 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44629 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41269,1676566908121)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44629 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:44629 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44629 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:44629 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44629 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44629 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=575 (was 658), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=390 (was 354) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=1103 (was 1144) 2023-02-16 17:01:52,036 INFO [Listener at localhost/45745] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=273, OpenFileDescriptor=575, MaxFileDescriptor=60000, SystemLoadAverage=390, ProcessCount=170, AvailableMemoryMB=1103 2023-02-16 17:01:52,048 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/hadoop.log.dir so I do NOT create it in target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51 2023-02-16 17:01:52,048 WARN [Listener at localhost/45745] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/hadoop.log.dir Erasing configuration value by system value. 2023-02-16 17:01:52,048 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/hadoop.tmp.dir so I do NOT create it in target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51 2023-02-16 17:01:52,048 WARN [Listener at localhost/45745] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c967233d-e8a6-059d-ef9f-eb3ae178f98c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-16 17:01:52,048 DEBUG [Listener at localhost/45745] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51 2023-02-16 17:01:52,048 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-16 17:01:52,048 INFO [Listener at localhost/45745] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/cluster_67ac2b58-4f98-1cd9-5bc1-e6282e429d8a, deleteOnExit=true 2023-02-16 17:01:52,048 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-16 17:01:52,048 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/test.cache.data in system properties and HBase conf 2023-02-16 17:01:52,049 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/hadoop.tmp.dir in system properties and HBase conf 2023-02-16 17:01:52,049 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/hadoop.log.dir in system properties and HBase conf 2023-02-16 17:01:52,049 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-16 17:01:52,049 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-16 17:01:52,049 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-16 17:01:52,049 DEBUG [Listener at localhost/45745] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-16 17:01:52,049 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:01:52,049 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-16 17:01:52,049 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-16 17:01:52,050 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:01:52,050 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-16 17:01:52,050 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-16 17:01:52,050 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-16 17:01:52,050 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:01:52,050 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-16 17:01:52,050 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/nfs.dump.dir in system properties and HBase conf 2023-02-16 17:01:52,050 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/java.io.tmpdir in system properties and HBase conf 2023-02-16 17:01:52,050 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-16 17:01:52,051 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-16 17:01:52,051 INFO [Listener at localhost/45745] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-16 17:01:52,055 WARN [Listener at localhost/45745] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:01:52,055 WARN [Listener at localhost/45745] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:01:52,132 WARN [Listener at localhost/45745] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:52,134 INFO [Listener at localhost/45745] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:52,141 INFO [Listener at localhost/45745] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/java.io.tmpdir/Jetty_localhost_45631_hdfs____.kntc9v/webapp 2023-02-16 17:01:52,237 INFO [Listener at localhost/45745] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45631 2023-02-16 17:01:52,242 WARN [Listener at localhost/45745] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-16 17:01:52,242 WARN [Listener at localhost/45745] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-16 17:01:52,286 WARN [Listener at localhost/46567] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:52,297 WARN [Listener at localhost/46567] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:52,299 WARN [Listener at localhost/46567] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:52,300 INFO [Listener at localhost/46567] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:52,305 INFO [Listener at localhost/46567] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/java.io.tmpdir/Jetty_localhost_33893_datanode____41qxuh/webapp 2023-02-16 17:01:52,401 INFO [Listener at localhost/46567] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33893 2023-02-16 17:01:52,408 WARN [Listener at localhost/32817] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:52,422 WARN [Listener at localhost/32817] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-16 17:01:52,424 WARN [Listener at localhost/32817] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-16 17:01:52,425 INFO [Listener at localhost/32817] log.Slf4jLog(67): jetty-6.1.26 2023-02-16 17:01:52,428 INFO [Listener at localhost/32817] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/java.io.tmpdir/Jetty_localhost_35581_datanode____1gmx4j/webapp 2023-02-16 17:01:52,509 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8220ead9f17cc09c: Processing first storage report for DS-8eca00a3-f0f1-49b0-a8de-e2ebf42b7a41 from datanode 232b50c9-4039-4d72-9e27-1dc33524b50f 2023-02-16 17:01:52,509 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8220ead9f17cc09c: from storage DS-8eca00a3-f0f1-49b0-a8de-e2ebf42b7a41 node DatanodeRegistration(127.0.0.1:34917, datanodeUuid=232b50c9-4039-4d72-9e27-1dc33524b50f, infoPort=35855, infoSecurePort=0, ipcPort=32817, storageInfo=lv=-57;cid=testClusterID;nsid=1428251429;c=1676566912093), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:52,509 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8220ead9f17cc09c: Processing first storage report for DS-57109d40-3f71-4d73-beca-32b19905ea9b from datanode 232b50c9-4039-4d72-9e27-1dc33524b50f 2023-02-16 17:01:52,509 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8220ead9f17cc09c: from storage DS-57109d40-3f71-4d73-beca-32b19905ea9b node DatanodeRegistration(127.0.0.1:34917, datanodeUuid=232b50c9-4039-4d72-9e27-1dc33524b50f, infoPort=35855, infoSecurePort=0, ipcPort=32817, storageInfo=lv=-57;cid=testClusterID;nsid=1428251429;c=1676566912093), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:52,532 INFO [Listener at localhost/32817] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35581 2023-02-16 17:01:52,543 WARN [Listener at localhost/40593] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-16 17:01:52,655 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaed16f681831210: Processing first storage report for DS-cf89d20c-2265-4efb-a500-3713ef6f9613 from datanode 10a3066d-4504-4520-a6f8-da1033be9250 2023-02-16 17:01:52,655 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaed16f681831210: from storage DS-cf89d20c-2265-4efb-a500-3713ef6f9613 node DatanodeRegistration(127.0.0.1:41425, datanodeUuid=10a3066d-4504-4520-a6f8-da1033be9250, infoPort=45303, infoSecurePort=0, ipcPort=40593, storageInfo=lv=-57;cid=testClusterID;nsid=1428251429;c=1676566912093), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:52,655 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaed16f681831210: Processing first storage report for DS-9c5249eb-bd3e-4f7d-8634-8c62d21a35f4 from datanode 10a3066d-4504-4520-a6f8-da1033be9250 2023-02-16 17:01:52,655 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaed16f681831210: from storage DS-9c5249eb-bd3e-4f7d-8634-8c62d21a35f4 node DatanodeRegistration(127.0.0.1:41425, datanodeUuid=10a3066d-4504-4520-a6f8-da1033be9250, infoPort=45303, infoSecurePort=0, ipcPort=40593, storageInfo=lv=-57;cid=testClusterID;nsid=1428251429;c=1676566912093), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-16 17:01:52,657 DEBUG [Listener at localhost/40593] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51 2023-02-16 17:01:52,659 INFO [Listener at localhost/40593] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/cluster_67ac2b58-4f98-1cd9-5bc1-e6282e429d8a/zookeeper_0, clientPort=57466, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/cluster_67ac2b58-4f98-1cd9-5bc1-e6282e429d8a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/cluster_67ac2b58-4f98-1cd9-5bc1-e6282e429d8a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-16 17:01:52,660 INFO [Listener at localhost/40593] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57466 2023-02-16 17:01:52,660 INFO [Listener at localhost/40593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:52,661 INFO [Listener at localhost/40593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:52,672 INFO [Listener at localhost/40593] util.FSUtils(479): Created version file at hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698 with version=8 2023-02-16 17:01:52,672 INFO [Listener at localhost/40593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:52,673 INFO [Listener at localhost/40593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:52,674 INFO [Listener at localhost/40593] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46567/user/jenkins/test-data/74e327d8-fe40-dadc-93fc-96ff3820b37d/hbase-staging 2023-02-16 17:01:52,675 INFO [Listener at localhost/40593] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:52,676 INFO [Listener at localhost/40593] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:52,676 INFO [Listener at localhost/40593] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:52,676 INFO [Listener at localhost/40593] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:52,676 INFO [Listener at localhost/40593] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:52,676 INFO [Listener at localhost/40593] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:52,676 INFO [Listener at localhost/40593] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:52,677 INFO [Listener at localhost/40593] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42757 2023-02-16 17:01:52,677 INFO [Listener at localhost/40593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:52,678 INFO [Listener at localhost/40593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:52,678 INFO [Listener at localhost/40593] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42757 connecting to ZooKeeper ensemble=127.0.0.1:57466 2023-02-16 17:01:52,686 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:427570x0, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:52,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42757-0x1005e14c8570000 connected 2023-02-16 17:01:52,698 DEBUG [Listener at localhost/40593] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:52,698 DEBUG [Listener at localhost/40593] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:52,698 DEBUG [Listener at localhost/40593] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:52,699 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42757 2023-02-16 17:01:52,700 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42757 2023-02-16 17:01:52,700 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42757 2023-02-16 17:01:52,700 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42757 2023-02-16 17:01:52,700 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42757 2023-02-16 17:01:52,700 INFO [Listener at localhost/40593] master.HMaster(444): hbase.rootdir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698, hbase.cluster.distributed=false 2023-02-16 17:01:52,712 INFO [Listener at localhost/40593] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:52,713 INFO [Listener at localhost/40593] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:52,713 INFO [Listener at localhost/40593] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:52,713 INFO [Listener at localhost/40593] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:52,713 INFO [Listener at localhost/40593] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:52,713 INFO [Listener at localhost/40593] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:52,713 INFO [Listener at localhost/40593] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:52,713 INFO [Listener at localhost/40593] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46445 2023-02-16 17:01:52,714 INFO [Listener at localhost/40593] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:52,714 DEBUG [Listener at localhost/40593] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:52,714 INFO [Listener at localhost/40593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:52,715 INFO [Listener at localhost/40593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:52,716 INFO [Listener at localhost/40593] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46445 connecting to ZooKeeper ensemble=127.0.0.1:57466 2023-02-16 17:01:52,719 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:464450x0, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:52,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46445-0x1005e14c8570001 connected 2023-02-16 17:01:52,721 DEBUG [Listener at localhost/40593] zookeeper.ZKUtil(164): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:52,722 DEBUG [Listener at localhost/40593] zookeeper.ZKUtil(164): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:52,722 DEBUG [Listener at localhost/40593] zookeeper.ZKUtil(164): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:52,722 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46445 2023-02-16 17:01:52,723 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46445 2023-02-16 17:01:52,723 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46445 2023-02-16 17:01:52,723 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46445 2023-02-16 17:01:52,723 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46445 2023-02-16 17:01:52,734 INFO [Listener at localhost/40593] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-16 17:01:52,734 INFO [Listener at localhost/40593] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:52,734 INFO [Listener at localhost/40593] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:52,734 INFO [Listener at localhost/40593] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-16 17:01:52,734 INFO [Listener at localhost/40593] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-16 17:01:52,734 INFO [Listener at localhost/40593] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-16 17:01:52,734 INFO [Listener at localhost/40593] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-16 17:01:52,735 INFO [Listener at localhost/40593] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46343 2023-02-16 17:01:52,735 INFO [Listener at localhost/40593] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-16 17:01:52,735 DEBUG [Listener at localhost/40593] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:52,736 INFO [Listener at localhost/40593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:52,736 INFO [Listener at localhost/40593] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:52,737 INFO [Listener at localhost/40593] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46343 connecting to ZooKeeper ensemble=127.0.0.1:57466 2023-02-16 17:01:52,739 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:463430x0, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-16 17:01:52,740 DEBUG [Listener at localhost/40593] zookeeper.ZKUtil(164): regionserver:463430x0, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:52,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46343-0x1005e14c8570002 connected 2023-02-16 17:01:52,741 DEBUG [Listener at localhost/40593] zookeeper.ZKUtil(164): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:52,741 DEBUG [Listener at localhost/40593] zookeeper.ZKUtil(164): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-16 17:01:52,741 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46343 2023-02-16 17:01:52,741 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46343 2023-02-16 17:01:52,742 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46343 2023-02-16 17:01:52,742 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46343 2023-02-16 17:01:52,742 DEBUG [Listener at localhost/40593] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46343 2023-02-16 17:01:52,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42757,1676566912675 2023-02-16 17:01:52,744 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:52,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42757,1676566912675 2023-02-16 17:01:52,746 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:52,746 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:52,746 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:52,748 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:52,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:52,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42757,1676566912675 from backup master directory 2023-02-16 17:01:52,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-16 17:01:52,751 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42757,1676566912675 2023-02-16 17:01:52,751 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-16 17:01:52,751 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:52,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42757,1676566912675 2023-02-16 17:01:52,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/hbase.id with ID: 78c0c9d3-595b-4b5c-8d88-172c2792829b 2023-02-16 17:01:52,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-16 17:01:52,768 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:52,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x07f3a249 to 127.0.0.1:57466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:52,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d0e9b0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:52,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:52,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-16 17:01:52,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:52,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/data/master/store-tmp 2023-02-16 17:01:52,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:52,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:52,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:52,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:52,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:52,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:52,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:52,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:52,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/WALs/jenkins-hbase4.apache.org,42757,1676566912675 2023-02-16 17:01:52,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42757%2C1676566912675, suffix=, logDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/WALs/jenkins-hbase4.apache.org,42757,1676566912675, archiveDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/oldWALs, maxLogs=10 2023-02-16 17:01:52,798 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41425,DS-cf89d20c-2265-4efb-a500-3713ef6f9613,DISK] 2023-02-16 17:01:52,799 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34917,DS-8eca00a3-f0f1-49b0-a8de-e2ebf42b7a41,DISK] 2023-02-16 17:01:52,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/WALs/jenkins-hbase4.apache.org,42757,1676566912675/jenkins-hbase4.apache.org%2C42757%2C1676566912675.1676566912786 2023-02-16 17:01:52,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41425,DS-cf89d20c-2265-4efb-a500-3713ef6f9613,DISK], DatanodeInfoWithStorage[127.0.0.1:34917,DS-8eca00a3-f0f1-49b0-a8de-e2ebf42b7a41,DISK]] 2023-02-16 17:01:52,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:52,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:52,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:52,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:52,802 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:52,803 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-16 17:01:52,803 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-16 17:01:52,803 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:52,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:52,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:52,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-16 17:01:52,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:52,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64793231, jitterRate=-0.03450562059879303}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:52,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:52,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-16 17:01:52,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-16 17:01:52,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-16 17:01:52,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-16 17:01:52,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-16 17:01:52,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-16 17:01:52,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-16 17:01:52,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-16 17:01:52,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-16 17:01:52,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-16 17:01:52,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-16 17:01:52,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-16 17:01:52,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-16 17:01:52,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-16 17:01:52,827 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:52,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-16 17:01:52,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-16 17:01:52,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-16 17:01:52,830 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:52,830 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:52,830 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:52,830 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:52,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42757,1676566912675, sessionid=0x1005e14c8570000, setting cluster-up flag (Was=false) 2023-02-16 17:01:52,835 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:52,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-16 17:01:52,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42757,1676566912675 2023-02-16 17:01:52,843 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:52,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-16 17:01:52,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42757,1676566912675 2023-02-16 17:01:52,848 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.hbase-snapshot/.tmp 2023-02-16 17:01:52,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:52,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:52,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:52,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:52,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-16 17:01:52,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-16 17:01:52,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:52,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676566942851 2023-02-16 17:01:52,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-16 17:01:52,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-16 17:01:52,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-16 17:01:52,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-16 17:01:52,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-16 17:01:52,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-16 17:01:52,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:52,852 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:52,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-16 17:01:52,852 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-16 17:01:52,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-16 17:01:52,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-16 17:01:52,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-16 17:01:52,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-16 17:01:52,853 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:52,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566912853,5,FailOnTimeoutGroup] 2023-02-16 17:01:52,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566912856,5,FailOnTimeoutGroup] 2023-02-16 17:01:52,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:52,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-16 17:01:52,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:52,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:52,861 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:52,862 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:52,862 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698 2023-02-16 17:01:52,867 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:52,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:52,869 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/info 2023-02-16 17:01:52,869 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:52,870 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:52,870 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:52,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:52,871 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:52,871 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:52,871 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:52,872 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/table 2023-02-16 17:01:52,872 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:52,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:52,873 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740 2023-02-16 17:01:52,873 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740 2023-02-16 17:01:52,875 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:52,875 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:52,876 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:52,877 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63847867, jitterRate=-0.048592641949653625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:52,877 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:52,877 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:52,877 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:52,877 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:52,877 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:52,877 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:52,877 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:52,877 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:52,878 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-16 17:01:52,878 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-16 17:01:52,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-16 17:01:52,879 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-16 17:01:52,880 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-16 17:01:52,944 INFO [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(952): ClusterId : 78c0c9d3-595b-4b5c-8d88-172c2792829b 2023-02-16 17:01:52,944 INFO [RS:1;jenkins-hbase4:46343] regionserver.HRegionServer(952): ClusterId : 78c0c9d3-595b-4b5c-8d88-172c2792829b 2023-02-16 17:01:52,944 DEBUG [RS:0;jenkins-hbase4:46445] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:52,944 DEBUG [RS:1;jenkins-hbase4:46343] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-16 17:01:52,946 DEBUG [RS:0;jenkins-hbase4:46445] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:52,946 DEBUG [RS:0;jenkins-hbase4:46445] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:52,946 DEBUG [RS:1;jenkins-hbase4:46343] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-16 17:01:52,946 DEBUG [RS:1;jenkins-hbase4:46343] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-16 17:01:52,949 DEBUG [RS:1;jenkins-hbase4:46343] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:52,950 DEBUG [RS:0;jenkins-hbase4:46445] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-16 17:01:52,950 DEBUG [RS:1;jenkins-hbase4:46343] zookeeper.ReadOnlyZKClient(139): Connect 0x7dd4b618 to 127.0.0.1:57466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:52,950 DEBUG [RS:0;jenkins-hbase4:46445] zookeeper.ReadOnlyZKClient(139): Connect 0x60ac5080 to 127.0.0.1:57466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:52,953 DEBUG [RS:1;jenkins-hbase4:46343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@731347d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:52,953 DEBUG [RS:0;jenkins-hbase4:46445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e6bb2e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:52,953 DEBUG [RS:1;jenkins-hbase4:46343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@772cdd68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:52,953 DEBUG [RS:0;jenkins-hbase4:46445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a543bf0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:52,967 DEBUG [RS:0;jenkins-hbase4:46445] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46445 2023-02-16 17:01:52,967 DEBUG [RS:1;jenkins-hbase4:46343] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46343 2023-02-16 17:01:52,967 INFO [RS:0;jenkins-hbase4:46445] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:52,967 INFO [RS:0;jenkins-hbase4:46445] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:52,967 INFO [RS:1;jenkins-hbase4:46343] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-16 17:01:52,967 INFO [RS:1;jenkins-hbase4:46343] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-16 17:01:52,967 DEBUG [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:52,967 DEBUG [RS:1;jenkins-hbase4:46343] regionserver.HRegionServer(1023): About to register with Master. 2023-02-16 17:01:52,968 INFO [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42757,1676566912675 with isa=jenkins-hbase4.apache.org/172.31.14.131:46445, startcode=1676566912712 2023-02-16 17:01:52,968 INFO [RS:1;jenkins-hbase4:46343] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42757,1676566912675 with isa=jenkins-hbase4.apache.org/172.31.14.131:46343, startcode=1676566912733 2023-02-16 17:01:52,968 DEBUG [RS:0;jenkins-hbase4:46445] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:52,968 DEBUG [RS:1;jenkins-hbase4:46343] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-16 17:01:52,970 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41137, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:52,970 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48945, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-16 17:01:52,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42757] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:52,972 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:52,973 DEBUG [RS:1;jenkins-hbase4:46343] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698 2023-02-16 17:01:52,973 DEBUG [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698 2023-02-16 17:01:52,973 DEBUG [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46567 2023-02-16 17:01:52,973 DEBUG [RS:1;jenkins-hbase4:46343] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46567 2023-02-16 17:01:52,973 DEBUG [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:52,973 DEBUG [RS:1;jenkins-hbase4:46343] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-16 17:01:52,977 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:52,978 DEBUG [RS:0;jenkins-hbase4:46445] zookeeper.ZKUtil(162): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:52,978 DEBUG [RS:1;jenkins-hbase4:46343] zookeeper.ZKUtil(162): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:52,978 WARN [RS:0;jenkins-hbase4:46445] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:52,978 WARN [RS:1;jenkins-hbase4:46343] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-16 17:01:52,978 INFO [RS:0;jenkins-hbase4:46445] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:52,978 INFO [RS:1;jenkins-hbase4:46343] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:52,978 DEBUG [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/WALs/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:52,978 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46343,1676566912733] 2023-02-16 17:01:52,978 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46445,1676566912712] 2023-02-16 17:01:52,978 DEBUG [RS:1;jenkins-hbase4:46343] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/WALs/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:52,983 DEBUG [RS:0;jenkins-hbase4:46445] zookeeper.ZKUtil(162): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:52,983 DEBUG [RS:1;jenkins-hbase4:46343] zookeeper.ZKUtil(162): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:52,984 DEBUG [RS:0;jenkins-hbase4:46445] zookeeper.ZKUtil(162): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:52,984 DEBUG [RS:1;jenkins-hbase4:46343] zookeeper.ZKUtil(162): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:52,984 DEBUG [RS:0;jenkins-hbase4:46445] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:52,984 DEBUG [RS:1;jenkins-hbase4:46343] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-16 17:01:52,985 INFO [RS:1;jenkins-hbase4:46343] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:52,985 INFO [RS:0;jenkins-hbase4:46445] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-16 17:01:52,989 INFO [RS:1;jenkins-hbase4:46343] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:52,989 INFO [RS:0;jenkins-hbase4:46445] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-16 17:01:52,989 INFO [RS:1;jenkins-hbase4:46343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:52,989 INFO [RS:0;jenkins-hbase4:46445] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-16 17:01:52,989 INFO [RS:1;jenkins-hbase4:46343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:52,989 INFO [RS:0;jenkins-hbase4:46445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:52,990 INFO [RS:1;jenkins-hbase4:46343] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:52,990 INFO [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-16 17:01:52,994 INFO [RS:1;jenkins-hbase4:46343] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:52,994 INFO [RS:0;jenkins-hbase4:46445] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:52,994 DEBUG [RS:1;jenkins-hbase4:46343] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,995 DEBUG [RS:1;jenkins-hbase4:46343] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,995 DEBUG [RS:0;jenkins-hbase4:46445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,995 DEBUG [RS:1;jenkins-hbase4:46343] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,995 DEBUG [RS:0;jenkins-hbase4:46445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,995 DEBUG [RS:1;jenkins-hbase4:46343] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,995 DEBUG [RS:0;jenkins-hbase4:46445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,995 DEBUG [RS:1;jenkins-hbase4:46343] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,995 DEBUG [RS:0;jenkins-hbase4:46445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,995 DEBUG [RS:1;jenkins-hbase4:46343] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:52,995 DEBUG [RS:0;jenkins-hbase4:46445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,995 DEBUG [RS:1;jenkins-hbase4:46343] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,995 DEBUG [RS:0;jenkins-hbase4:46445] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-16 17:01:52,995 DEBUG [RS:1;jenkins-hbase4:46343] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,996 DEBUG [RS:0;jenkins-hbase4:46445] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,996 DEBUG [RS:1;jenkins-hbase4:46343] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,996 DEBUG [RS:0;jenkins-hbase4:46445] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,996 DEBUG [RS:1;jenkins-hbase4:46343] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,996 DEBUG [RS:0;jenkins-hbase4:46445] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:52,996 DEBUG [RS:0;jenkins-hbase4:46445] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-16 17:01:53,000 INFO [RS:1;jenkins-hbase4:46343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,000 INFO [RS:1;jenkins-hbase4:46343] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,000 INFO [RS:1;jenkins-hbase4:46343] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,001 INFO [RS:0;jenkins-hbase4:46445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,001 INFO [RS:0;jenkins-hbase4:46445] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,001 INFO [RS:0;jenkins-hbase4:46445] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,012 INFO [RS:1;jenkins-hbase4:46343] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:53,012 INFO [RS:1;jenkins-hbase4:46343] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46343,1676566912733-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,018 INFO [RS:0;jenkins-hbase4:46445] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-16 17:01:53,018 INFO [RS:0;jenkins-hbase4:46445] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46445,1676566912712-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,025 INFO [RS:1;jenkins-hbase4:46343] regionserver.Replication(203): jenkins-hbase4.apache.org,46343,1676566912733 started 2023-02-16 17:01:53,025 INFO [RS:1;jenkins-hbase4:46343] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46343,1676566912733, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46343, sessionid=0x1005e14c8570002 2023-02-16 17:01:53,025 DEBUG [RS:1;jenkins-hbase4:46343] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:53,025 DEBUG [RS:1;jenkins-hbase4:46343] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:53,025 DEBUG [RS:1;jenkins-hbase4:46343] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46343,1676566912733' 2023-02-16 17:01:53,025 DEBUG [RS:1;jenkins-hbase4:46343] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:53,026 DEBUG [RS:1;jenkins-hbase4:46343] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:53,026 DEBUG [RS:1;jenkins-hbase4:46343] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:53,026 DEBUG [RS:1;jenkins-hbase4:46343] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:53,026 DEBUG [RS:1;jenkins-hbase4:46343] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:53,026 DEBUG [RS:1;jenkins-hbase4:46343] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46343,1676566912733' 2023-02-16 17:01:53,026 DEBUG [RS:1;jenkins-hbase4:46343] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:53,026 DEBUG [RS:1;jenkins-hbase4:46343] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:53,027 DEBUG [RS:1;jenkins-hbase4:46343] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:53,027 INFO [RS:1;jenkins-hbase4:46343] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:53,027 INFO [RS:1;jenkins-hbase4:46343] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:53,029 INFO [RS:0;jenkins-hbase4:46445] regionserver.Replication(203): jenkins-hbase4.apache.org,46445,1676566912712 started 2023-02-16 17:01:53,029 INFO [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46445,1676566912712, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46445, sessionid=0x1005e14c8570001 2023-02-16 17:01:53,029 DEBUG [RS:0;jenkins-hbase4:46445] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-16 17:01:53,029 DEBUG [RS:0;jenkins-hbase4:46445] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:53,029 DEBUG [RS:0;jenkins-hbase4:46445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46445,1676566912712' 2023-02-16 17:01:53,029 DEBUG [RS:0;jenkins-hbase4:46445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:53,029 DEBUG [RS:0;jenkins-hbase4:46445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:53,029 DEBUG [RS:0;jenkins-hbase4:46445] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-16 17:01:53,029 DEBUG [RS:0;jenkins-hbase4:46445] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-16 17:01:53,029 DEBUG [RS:0;jenkins-hbase4:46445] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:53,029 DEBUG [RS:0;jenkins-hbase4:46445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46445,1676566912712' 2023-02-16 17:01:53,029 DEBUG [RS:0;jenkins-hbase4:46445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:53,030 DEBUG [RS:0;jenkins-hbase4:46445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:53,030 DEBUG [RS:0;jenkins-hbase4:46445] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-16 17:01:53,030 INFO [RS:0;jenkins-hbase4:46445] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-16 17:01:53,030 INFO [RS:0;jenkins-hbase4:46445] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-16 17:01:53,030 DEBUG [jenkins-hbase4:42757] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-16 17:01:53,031 DEBUG [jenkins-hbase4:42757] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:53,032 DEBUG [jenkins-hbase4:42757] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:53,032 DEBUG [jenkins-hbase4:42757] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:53,032 DEBUG [jenkins-hbase4:42757] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:53,032 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46445,1676566912712, state=OPENING 2023-02-16 17:01:53,033 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-16 17:01:53,034 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:53,034 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46445,1676566912712}] 2023-02-16 17:01:53,034 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:53,189 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:53,189 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:53,191 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35436, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:53,194 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-16 17:01:53,194 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-16 17:01:53,195 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46445%2C1676566912712.meta, suffix=.meta, logDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/WALs/jenkins-hbase4.apache.org,46445,1676566912712, archiveDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/oldWALs, maxLogs=32 2023-02-16 17:01:53,212 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41425,DS-cf89d20c-2265-4efb-a500-3713ef6f9613,DISK] 2023-02-16 17:01:53,212 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34917,DS-8eca00a3-f0f1-49b0-a8de-e2ebf42b7a41,DISK] 2023-02-16 17:01:53,213 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/WALs/jenkins-hbase4.apache.org,46445,1676566912712/jenkins-hbase4.apache.org%2C46445%2C1676566912712.meta.1676566913195.meta 2023-02-16 17:01:53,213 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41425,DS-cf89d20c-2265-4efb-a500-3713ef6f9613,DISK], DatanodeInfoWithStorage[127.0.0.1:34917,DS-8eca00a3-f0f1-49b0-a8de-e2ebf42b7a41,DISK]] 2023-02-16 17:01:53,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:53,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-16 17:01:53,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-16 17:01:53,214 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-16 17:01:53,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-16 17:01:53,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:53,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-16 17:01:53,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-16 17:01:53,215 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-16 17:01:53,216 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/info 2023-02-16 17:01:53,216 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/info 2023-02-16 17:01:53,216 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-16 17:01:53,217 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:53,217 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-16 17:01:53,217 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:53,217 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/rep_barrier 2023-02-16 17:01:53,217 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-16 17:01:53,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:53,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-16 17:01:53,218 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/table 2023-02-16 17:01:53,218 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/table 2023-02-16 17:01:53,219 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-16 17:01:53,219 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:53,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740 2023-02-16 17:01:53,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740 2023-02-16 17:01:53,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-16 17:01:53,222 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-16 17:01:53,222 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68098095, jitterRate=0.01474069058895111}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-16 17:01:53,222 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-16 17:01:53,223 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676566913189 2023-02-16 17:01:53,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-16 17:01:53,226 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-16 17:01:53,227 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46445,1676566912712, state=OPEN 2023-02-16 17:01:53,229 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-16 17:01:53,229 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-16 17:01:53,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-16 17:01:53,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46445,1676566912712 in 195 msec 2023-02-16 17:01:53,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-16 17:01:53,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-16 17:01:53,233 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 384 msec 2023-02-16 17:01:53,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676566913233, completionTime=-1 2023-02-16 17:01:53,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-16 17:01:53,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-16 17:01:53,235 DEBUG [hconnection-0x55531ca-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:53,237 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35450, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:53,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-16 17:01:53,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676566973237 2023-02-16 17:01:53,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676567033238 2023-02-16 17:01:53,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-16 17:01:53,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42757,1676566912675-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42757,1676566912675-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42757,1676566912675-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42757, period=300000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-16 17:01:53,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-16 17:01:53,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:53,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-16 17:01:53,243 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-16 17:01:53,245 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:53,245 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:53,246 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d 2023-02-16 17:01:53,247 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d empty. 2023-02-16 17:01:53,247 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d 2023-02-16 17:01:53,247 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-16 17:01:53,259 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:53,260 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 298e1c693ce70e13e480e83bdcec9e8d, NAME => 'hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp 2023-02-16 17:01:53,266 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:53,266 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 298e1c693ce70e13e480e83bdcec9e8d, disabling compactions & flushes 2023-02-16 17:01:53,266 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. 2023-02-16 17:01:53,266 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. 2023-02-16 17:01:53,266 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. after waiting 0 ms 2023-02-16 17:01:53,266 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. 2023-02-16 17:01:53,266 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. 2023-02-16 17:01:53,266 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 298e1c693ce70e13e480e83bdcec9e8d: 2023-02-16 17:01:53,268 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:53,268 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566913268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566913268"}]},"ts":"1676566913268"} 2023-02-16 17:01:53,269 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 17:01:53,270 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:53,270 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566913270"}]},"ts":"1676566913270"} 2023-02-16 17:01:53,271 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-16 17:01:53,275 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:53,275 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:53,275 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:53,275 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:53,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=298e1c693ce70e13e480e83bdcec9e8d, ASSIGN}] 2023-02-16 17:01:53,279 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=298e1c693ce70e13e480e83bdcec9e8d, ASSIGN 2023-02-16 17:01:53,280 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=298e1c693ce70e13e480e83bdcec9e8d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46445,1676566912712; forceNewPlan=false, retain=false 2023-02-16 17:01:53,430 INFO [jenkins-hbase4:42757] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 17:01:53,430 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=298e1c693ce70e13e480e83bdcec9e8d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:53,430 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566913430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566913430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566913430"}]},"ts":"1676566913430"} 2023-02-16 17:01:53,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 298e1c693ce70e13e480e83bdcec9e8d, server=jenkins-hbase4.apache.org,46445,1676566912712}] 2023-02-16 17:01:53,586 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. 2023-02-16 17:01:53,587 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46445%2C1676566912712, suffix=, logDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/WALs/jenkins-hbase4.apache.org,46445,1676566912712, archiveDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/oldWALs, maxLogs=32 2023-02-16 17:01:53,601 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41425,DS-cf89d20c-2265-4efb-a500-3713ef6f9613,DISK] 2023-02-16 17:01:53,601 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34917,DS-8eca00a3-f0f1-49b0-a8de-e2ebf42b7a41,DISK] 2023-02-16 17:01:53,602 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/WALs/jenkins-hbase4.apache.org,46445,1676566912712/jenkins-hbase4.apache.org%2C46445%2C1676566912712.1676566913588 2023-02-16 17:01:53,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41425,DS-cf89d20c-2265-4efb-a500-3713ef6f9613,DISK], DatanodeInfoWithStorage[127.0.0.1:34917,DS-8eca00a3-f0f1-49b0-a8de-e2ebf42b7a41,DISK]] 2023-02-16 17:01:53,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 298e1c693ce70e13e480e83bdcec9e8d, NAME => 'hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:53,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 298e1c693ce70e13e480e83bdcec9e8d 2023-02-16 17:01:53,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:53,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 298e1c693ce70e13e480e83bdcec9e8d 2023-02-16 17:01:53,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 298e1c693ce70e13e480e83bdcec9e8d 2023-02-16 17:01:53,604 INFO [StoreOpener-298e1c693ce70e13e480e83bdcec9e8d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 298e1c693ce70e13e480e83bdcec9e8d 2023-02-16 17:01:53,605 DEBUG [StoreOpener-298e1c693ce70e13e480e83bdcec9e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d/info 2023-02-16 17:01:53,605 DEBUG [StoreOpener-298e1c693ce70e13e480e83bdcec9e8d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d/info 2023-02-16 17:01:53,605 INFO [StoreOpener-298e1c693ce70e13e480e83bdcec9e8d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 298e1c693ce70e13e480e83bdcec9e8d columnFamilyName info 2023-02-16 17:01:53,606 INFO [StoreOpener-298e1c693ce70e13e480e83bdcec9e8d-1] regionserver.HStore(310): Store=298e1c693ce70e13e480e83bdcec9e8d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:53,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d 2023-02-16 17:01:53,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d 2023-02-16 17:01:53,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 298e1c693ce70e13e480e83bdcec9e8d 2023-02-16 17:01:53,610 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:53,610 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 298e1c693ce70e13e480e83bdcec9e8d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73747220, jitterRate=0.09891921281814575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-16 17:01:53,611 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 298e1c693ce70e13e480e83bdcec9e8d: 2023-02-16 17:01:53,611 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d., pid=6, masterSystemTime=1676566913583 2023-02-16 17:01:53,612 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. 2023-02-16 17:01:53,612 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. 2023-02-16 17:01:53,613 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=298e1c693ce70e13e480e83bdcec9e8d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:53,613 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676566913613"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566913613"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566913613"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566913613"}]},"ts":"1676566913613"} 2023-02-16 17:01:53,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-16 17:01:53,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 298e1c693ce70e13e480e83bdcec9e8d, server=jenkins-hbase4.apache.org,46445,1676566912712 in 182 msec 2023-02-16 17:01:53,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-16 17:01:53,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=298e1c693ce70e13e480e83bdcec9e8d, ASSIGN in 339 msec 2023-02-16 17:01:53,616 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:53,616 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566913616"}]},"ts":"1676566913616"} 2023-02-16 17:01:53,617 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-16 17:01:53,619 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:53,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 376 msec 2023-02-16 17:01:53,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-16 17:01:53,645 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:53,646 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:53,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-16 17:01:53,654 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:53,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-16 17:01:53,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-16 17:01:53,665 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-16 17:01:53,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-16 17:01:53,674 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-16 17:01:53,676 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-16 17:01:53,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.925sec 2023-02-16 17:01:53,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-16 17:01:53,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-16 17:01:53,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-16 17:01:53,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42757,1676566912675-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-16 17:01:53,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42757,1676566912675-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-16 17:01:53,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-16 17:01:53,745 DEBUG [Listener at localhost/40593] zookeeper.ReadOnlyZKClient(139): Connect 0x313de8a4 to 127.0.0.1:57466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:53,748 DEBUG [Listener at localhost/40593] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1783c817, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:53,750 DEBUG [hconnection-0x73912b69-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:53,751 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44388, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:53,753 INFO [Listener at localhost/40593] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42757,1676566912675 2023-02-16 17:01:53,753 DEBUG [Listener at localhost/40593] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-16 17:01:53,756 DEBUG [Listener at localhost/40593] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-16 17:01:53,757 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37282, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-16 17:01:53,757 INFO [Listener at localhost/40593] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 17:01:53,757 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 17:01:53,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-16 17:01:53,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:37282 deadline: 1676566973757, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-16 17:01:53,758 INFO [Listener at localhost/40593] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-16 17:01:53,760 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-16 17:01:53,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-16 17:01:53,762 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-16 17:01:53,762 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-16 17:01:53,763 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-16 17:01:53,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:53,764 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:53,764 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18 empty. 2023-02-16 17:01:53,765 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:53,765 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 17:01:53,776 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-16 17:01:53,777 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => fbb112badb86a110fd51ad23f0e3ec18, NAME => 'testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp 2023-02-16 17:01:53,783 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:53,783 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing fbb112badb86a110fd51ad23f0e3ec18, disabling compactions & flushes 2023-02-16 17:01:53,783 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:53,783 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:53,783 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. after waiting 0 ms 2023-02-16 17:01:53,783 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:53,783 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:53,783 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for fbb112badb86a110fd51ad23f0e3ec18: 2023-02-16 17:01:53,785 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-16 17:01:53,786 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676566913786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566913786"}]},"ts":"1676566913786"} 2023-02-16 17:01:53,787 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-16 17:01:53,788 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-16 17:01:53,788 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566913788"}]},"ts":"1676566913788"} 2023-02-16 17:01:53,789 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-16 17:01:53,792 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-16 17:01:53,793 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-16 17:01:53,793 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-16 17:01:53,793 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-16 17:01:53,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fbb112badb86a110fd51ad23f0e3ec18, ASSIGN}] 2023-02-16 17:01:53,794 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fbb112badb86a110fd51ad23f0e3ec18, ASSIGN 2023-02-16 17:01:53,794 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fbb112badb86a110fd51ad23f0e3ec18, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46343,1676566912733; forceNewPlan=false, retain=false 2023-02-16 17:01:53,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:53,945 INFO [jenkins-hbase4:42757] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-16 17:01:53,945 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fbb112badb86a110fd51ad23f0e3ec18, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:53,945 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676566913945"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566913945"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566913945"}]},"ts":"1676566913945"} 2023-02-16 17:01:53,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure fbb112badb86a110fd51ad23f0e3ec18, server=jenkins-hbase4.apache.org,46343,1676566912733}] 2023-02-16 17:01:54,028 INFO [RS:1;jenkins-hbase4:46343] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46343%2C1676566912733, suffix=, logDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/WALs/jenkins-hbase4.apache.org,46343,1676566912733, archiveDir=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/oldWALs, maxLogs=32 2023-02-16 17:01:54,048 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41425,DS-cf89d20c-2265-4efb-a500-3713ef6f9613,DISK] 2023-02-16 17:01:54,048 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34917,DS-8eca00a3-f0f1-49b0-a8de-e2ebf42b7a41,DISK] 2023-02-16 17:01:54,049 INFO [RS:1;jenkins-hbase4:46343] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/WALs/jenkins-hbase4.apache.org,46343,1676566912733/jenkins-hbase4.apache.org%2C46343%2C1676566912733.1676566914029 2023-02-16 17:01:54,050 DEBUG [RS:1;jenkins-hbase4:46343] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41425,DS-cf89d20c-2265-4efb-a500-3713ef6f9613,DISK], DatanodeInfoWithStorage[127.0.0.1:34917,DS-8eca00a3-f0f1-49b0-a8de-e2ebf42b7a41,DISK]] 2023-02-16 17:01:54,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:54,099 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,099 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-16 17:01:54,101 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47624, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-16 17:01:54,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:54,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fbb112badb86a110fd51ad23f0e3ec18, NAME => 'testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.', STARTKEY => '', ENDKEY => ''} 2023-02-16 17:01:54,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:54,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:54,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:54,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:54,105 INFO [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:54,106 DEBUG [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1 2023-02-16 17:01:54,106 DEBUG [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1 2023-02-16 17:01:54,106 INFO [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbb112badb86a110fd51ad23f0e3ec18 columnFamilyName f1 2023-02-16 17:01:54,107 INFO [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] regionserver.HStore(310): Store=fbb112badb86a110fd51ad23f0e3ec18/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:54,107 INFO [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:54,108 DEBUG [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2 2023-02-16 17:01:54,108 DEBUG [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2 2023-02-16 17:01:54,108 INFO [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbb112badb86a110fd51ad23f0e3ec18 columnFamilyName f2 2023-02-16 17:01:54,108 INFO [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] regionserver.HStore(310): Store=fbb112badb86a110fd51ad23f0e3ec18/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:54,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:54,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:54,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:54,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:54,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-16 17:01:54,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fbb112badb86a110fd51ad23f0e3ec18; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65533334, jitterRate=-0.023477226495742798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:54,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fbb112badb86a110fd51ad23f0e3ec18: 2023-02-16 17:01:54,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18., pid=12, masterSystemTime=1676566914099 2023-02-16 17:01:54,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:54,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:54,119 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fbb112badb86a110fd51ad23f0e3ec18, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,119 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676566914119"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676566914119"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676566914119"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676566914119"}]},"ts":"1676566914119"} 2023-02-16 17:01:54,122 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-16 17:01:54,122 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure fbb112badb86a110fd51ad23f0e3ec18, server=jenkins-hbase4.apache.org,46343,1676566912733 in 173 msec 2023-02-16 17:01:54,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-16 17:01:54,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fbb112badb86a110fd51ad23f0e3ec18, ASSIGN in 329 msec 2023-02-16 17:01:54,123 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-16 17:01:54,124 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566914123"}]},"ts":"1676566914123"} 2023-02-16 17:01:54,125 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-16 17:01:54,126 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-16 17:01:54,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 367 msec 2023-02-16 17:01:54,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-16 17:01:54,367 INFO [Listener at localhost/40593] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-16 17:01:54,367 DEBUG [Listener at localhost/40593] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-16 17:01:54,367 INFO [Listener at localhost/40593] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:54,369 INFO [Listener at localhost/40593] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-16 17:01:54,369 INFO [Listener at localhost/40593] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-16 17:01:54,369 INFO [Listener at localhost/40593] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-16 17:01:54,370 INFO [Listener at localhost/40593] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-16 17:01:54,382 DEBUG [hconnection-0x73912b69-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:54,393 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47634, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:54,401 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46343] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:54,489 INFO [Listener at localhost/40593] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-16 17:01:54,489 INFO [Listener at localhost/40593] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-16 17:01:54,490 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 17:01:54,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676566914490 (current time:1676566914490). 2023-02-16 17:01:54,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-16 17:01:54,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] zookeeper.ReadOnlyZKClient(139): Connect 0x3b1a38aa to 127.0.0.1:57466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-16 17:01:54,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30cee039, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-16 17:01:54,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-16 17:01:54,495 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44392, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-16 17:01:54,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b1a38aa to 127.0.0.1:57466 2023-02-16 17:01:54,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:54,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-16 17:01:54,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 17:01:54,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 17:01:54,499 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 17:01:54,500 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676567514500 2023-02-16 17:01:54,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-16 17:01:54,500 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-16 17:01:54,503 DEBUG [Listener at localhost/40593] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:54,503 DEBUG [Listener at localhost/40593] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-16 17:01:54,503 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-16 17:01:54,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 17:01:54,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-16 17:01:54,505 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 17:01:54,505 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676567514505 2023-02-16 17:01:54,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-16 17:01:54,514 INFO [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-16 17:01:54,514 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:54,515 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-16 17:01:54,515 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-16 17:01:54,515 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,515 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 17:01:54,516 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:54,516 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:54,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:54,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:54,516 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:54,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:54,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 17:01:54,517 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,517 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:54,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 17:01:54,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-16 17:01:54,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 17:01:54,517 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-16 17:01:54,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-16 17:01:54,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 17:01:54,518 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-16 17:01:54,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-16 17:01:54,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-16 17:01:54,522 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-16 17:01:54,522 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:54,522 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-16 17:01:54,522 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-16 17:01:54,522 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 17:01:54,525 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-16 17:01:54,525 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-16 17:01:54,525 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-16 17:01:54,525 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46445,1676566912712' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-16 17:01:54,525 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46343,1676566912733' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-16 17:01:54,526 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,526 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,526 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:54,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:54,526 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,526 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:54,526 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,526 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:54,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:54,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:54,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 17:01:54,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:54,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:54,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46343,1676566912733' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-16 17:01:54,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32375241[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:54,528 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-16 17:01:54,528 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,529 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,529 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,529 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 17:01:54,529 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-16 17:01:54,529 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-16 17:01:54,529 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,529 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:54,529 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46445,1676566912712' in zk 2023-02-16 17:01:54,529 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-16 17:01:54,530 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-16 17:01:54,530 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:54,530 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. started... 2023-02-16 17:01:54,530 INFO [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] regionserver.HRegion(2744): Flushing fbb112badb86a110fd51ad23f0e3ec18 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-16 17:01:54,532 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-16 17:01:54,532 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:54,532 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-16 17:01:54,548 INFO [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/.tmp/f1/1904690687d44fa692b62259d3bc741b 2023-02-16 17:01:54,575 INFO [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/.tmp/f2/b36d64ee8f5348a6badb3b4c6eff546b 2023-02-16 17:01:54,581 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/.tmp/f1/1904690687d44fa692b62259d3bc741b as hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1/1904690687d44fa692b62259d3bc741b 2023-02-16 17:01:54,585 INFO [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1/1904690687d44fa692b62259d3bc741b, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 17:01:54,586 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/.tmp/f2/b36d64ee8f5348a6badb3b4c6eff546b as hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2/b36d64ee8f5348a6badb3b4c6eff546b 2023-02-16 17:01:54,591 INFO [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2/b36d64ee8f5348a6badb3b4c6eff546b, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-16 17:01:54,592 INFO [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for fbb112badb86a110fd51ad23f0e3ec18 in 62ms, sequenceid=5, compaction requested=false 2023-02-16 17:01:54,592 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fbb112badb86a110fd51ad23f0e3ec18: 2023-02-16 17:01:54,592 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-16 17:01:54,592 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-16 17:01:54,592 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1/1904690687d44fa692b62259d3bc741b] hfiles 2023-02-16 17:01:54,592 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1/1904690687d44fa692b62259d3bc741b for snapshot=testWithMapReduceSingleRegion 2023-02-16 17:01:54,592 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2/b36d64ee8f5348a6badb3b4c6eff546b] hfiles 2023-02-16 17:01:54,592 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2/b36d64ee8f5348a6badb3b4c6eff546b for snapshot=testWithMapReduceSingleRegion 2023-02-16 17:01:54,602 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. completed. 2023-02-16 17:01:54,602 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:54,602 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-16 17:01:54,602 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-16 17:01:54,602 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,602 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-16 17:01:54,602 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46343,1676566912733' in zk 2023-02-16 17:01:54,603 DEBUG [Listener at localhost/40593] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:54,603 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,603 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-16 17:01:54,603 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:54,604 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-16 17:01:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:54,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 17:01:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:54,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-16 17:01:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 17:01:54,605 DEBUG [Listener at localhost/40593] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-16 17:01:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 17:01:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:54,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,46343,1676566912733': 2023-02-16 17:01:54,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46343,1676566912733' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-16 17:01:54,607 INFO [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-16 17:01:54,607 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:54,607 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:54,607 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-16 17:01:54,607 INFO [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-16 17:01:54,608 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,608 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,608 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-16 17:01:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,608 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:54,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,608 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:54,609 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:54,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 17:01:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,610 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 17:01:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:54,611 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-16 17:01:54,611 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:54,617 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:54,617 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:54,617 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 17:01:54,617 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-16 17:01:54,617 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:54,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:54,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:54,618 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:54,617 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-16 17:01:54,617 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-16 17:01:54,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-16 17:01:54,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-16 17:01:54,617 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:54,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:54,618 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-16 17:01:54,618 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:54,618 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,618 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,618 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-16 17:01:54,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-16 17:01:54,618 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-16 17:01:54,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 17:01:54,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-16 17:01:54,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-16 17:01:54,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-16 17:01:54,653 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-16 17:01:54,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 17:01:54,653 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-16 17:01:54,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676566914500Consolidate snapshot: testWithMapReduceSingleRegion at 1676566914618 (+118 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676566914618Writing data manifest for testWithMapReduceSingleRegion at 1676566914620 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676566914631 (+11 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676566914653 (+22 ms) 2023-02-16 17:01:54,653 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-16 17:01:54,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 150 msec 2023-02-16 17:01:54,805 DEBUG [Listener at localhost/40593] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-16 17:01:54,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-16 17:01:54,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-16 17:01:54,806 INFO [Listener at localhost/40593] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-16 17:01:54,810 INFO [Listener at localhost/40593] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-16 17:01:54,821 INFO [Listener at localhost/40593] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-16 17:01:54,858 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46343] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:54,944 INFO [Listener at localhost/40593] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-16 17:01:54,949 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-16 17:01:54,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-16 17:01:54,950 INFO [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-16 17:01:54,950 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:54,950 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-16 17:01:54,950 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-16 17:01:54,951 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:54,951 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:54,952 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:54,952 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:54,952 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:54,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:54,952 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:54,952 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-16 17:01:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:54,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:54,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:54,953 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 17:01:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-16 17:01:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:54,953 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-16 17:01:54,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 17:01:54,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-16 17:01:54,953 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 17:01:54,953 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:54,954 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-16 17:01:54,954 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 17:01:54,954 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-16 17:01:54,954 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-16 17:01:54,954 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 17:01:54,954 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46445,1676566912712' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 17:01:54,954 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-16 17:01:54,954 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-16 17:01:54,954 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:54,954 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. started... 2023-02-16 17:01:54,954 INFO [rs(jenkins-hbase4.apache.org,46343,1676566912733)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fbb112badb86a110fd51ad23f0e3ec18 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-16 17:01:54,955 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:54,955 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:54,955 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:54,969 INFO [rs(jenkins-hbase4.apache.org,46343,1676566912733)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/.tmp/f1/5e2c8815e0ce48ac8fafd19a9ce30dcc 2023-02-16 17:01:54,986 INFO [rs(jenkins-hbase4.apache.org,46343,1676566912733)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/.tmp/f2/20d4ce81ce1a4906bc1b5971c1ed6b7a 2023-02-16 17:01:54,991 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/.tmp/f1/5e2c8815e0ce48ac8fafd19a9ce30dcc as hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1/5e2c8815e0ce48ac8fafd19a9ce30dcc 2023-02-16 17:01:54,995 INFO [rs(jenkins-hbase4.apache.org,46343,1676566912733)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1/5e2c8815e0ce48ac8fafd19a9ce30dcc, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 17:01:54,996 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/.tmp/f2/20d4ce81ce1a4906bc1b5971c1ed6b7a as hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2/20d4ce81ce1a4906bc1b5971c1ed6b7a 2023-02-16 17:01:55,000 INFO [rs(jenkins-hbase4.apache.org,46343,1676566912733)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2/20d4ce81ce1a4906bc1b5971c1ed6b7a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-16 17:01:55,000 INFO [rs(jenkins-hbase4.apache.org,46343,1676566912733)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for fbb112badb86a110fd51ad23f0e3ec18 in 46ms, sequenceid=9, compaction requested=false 2023-02-16 17:01:55,001 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fbb112badb86a110fd51ad23f0e3ec18: 2023-02-16 17:01:55,001 DEBUG [rs(jenkins-hbase4.apache.org,46343,1676566912733)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-16 17:01:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-16 17:01:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-16 17:01:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46343,1676566912733' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-16 17:01:55,002 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,002 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:55,003 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:55,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:55,003 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-16 17:01:55,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:55,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:55,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:55,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:55,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46343,1676566912733' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-16 17:01:55,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3608c0df[Count = 0] remaining members to acquire global barrier 2023-02-16 17:01:55,005 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-16 17:01:55,005 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:55,007 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:55,007 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:55,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:55,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:55,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:55,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:55,007 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,007 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 17:01:55,007 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-16 17:01:55,007 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-16 17:01:55,007 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 17:01:55,007 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-16 17:01:55,007 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46343,1676566912733' in zk 2023-02-16 17:01:55,007 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46445,1676566912712' in zk 2023-02-16 17:01:55,009 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 17:01:55,009 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-16 17:01:55,009 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:55,009 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,009 DEBUG [member: 'jenkins-hbase4.apache.org,46343,1676566912733' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 17:01:55,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,009 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:55,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:55,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:55,009 DEBUG [member: 'jenkins-hbase4.apache.org,46445,1676566912712' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-16 17:01:55,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:55,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:55,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:55,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:55,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:55,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:55,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:55,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,46343,1676566912733': 2023-02-16 17:01:55,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46343,1676566912733' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-16 17:01:55,012 INFO [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-16 17:01:55,013 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-16 17:01:55,013 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-16 17:01:55,013 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-16 17:01:55,013 INFO [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-16 17:01:55,014 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:55,014 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:55,014 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:55,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:55,014 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:55,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:55,014 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-16 17:01:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-16 17:01:55,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:55,015 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-16 17:01:55,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:55,016 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-16 17:01:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:55,017 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-16 17:01:55,017 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-16 17:01:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:55,020 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:55,020 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:55,020 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-16 17:01:55,020 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:55,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:55,020 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,020 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:55,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-16 17:01:55,020 DEBUG [(jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-16 17:01:55,020 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-16 17:01:55,020 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-16 17:01:55,021 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-16 17:01:55,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:55,020 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-16 17:01:55,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-16 17:01:55,021 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:55,021 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:55,021 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:55,021 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-16 17:01:55,021 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-16 17:01:55,021 DEBUG [Listener at localhost/40593] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-16 17:01:55,021 DEBUG [Listener at localhost/40593] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-16 17:01:55,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:55,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:55,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-16 17:01:55,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-16 17:01:55,121 DEBUG [Listener at localhost/40593] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-16 17:01:55,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-16 17:01:55,212 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/hadoop-1642397241510451048.jar 2023-02-16 17:01:55,216 INFO [Listener at localhost/40593] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676566914490 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:55,217 DEBUG [Listener at localhost/40593] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46567/user/jenkins/test-data/74e327d8-fe40-dadc-93fc-96ff3820b37d/testWithMapReduceSingleRegion/22c2305a-eefb-4fb8-a7b4-eea16728e98b/data/default/testWithMapReduce 2023-02-16 17:01:55,217 INFO [Listener at localhost/40593] snapshot.RestoreSnapshotHelper(239): region to add: fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:55,217 INFO [Listener at localhost/40593] snapshot.RestoreSnapshotHelper(585): clone region=fbb112badb86a110fd51ad23f0e3ec18 as fbb112badb86a110fd51ad23f0e3ec18 in snapshot testWithMapReduceSingleRegion 2023-02-16 17:01:55,218 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => fbb112badb86a110fd51ad23f0e3ec18, NAME => 'testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46567/user/jenkins/test-data/74e327d8-fe40-dadc-93fc-96ff3820b37d/testWithMapReduceSingleRegion/22c2305a-eefb-4fb8-a7b4-eea16728e98b 2023-02-16 17:01:55,227 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:55,227 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1904690687d44fa692b62259d3bc741b from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-16 17:01:55,229 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b36d64ee8f5348a6badb3b4c6eff546b from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-16 17:01:55,231 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing fbb112badb86a110fd51ad23f0e3ec18, disabling compactions & flushes 2023-02-16 17:01:55,231 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:55,231 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:55,231 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. after waiting 0 ms 2023-02-16 17:01:55,231 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:55,231 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:55,231 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for fbb112badb86a110fd51ad23f0e3ec18: 2023-02-16 17:01:55,232 INFO [Listener at localhost/40593] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676566914490 type: FLUSH version: 2 ttl: 0 2023-02-16 17:01:55,232 DEBUG [Listener at localhost/40593] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46567/user/jenkins/test-data/74e327d8-fe40-dadc-93fc-96ff3820b37d/testWithMapReduceSingleRegion/22c2305a-eefb-4fb8-a7b4-eea16728e98b 2023-02-16 17:01:55,232 DEBUG [Listener at localhost/40593] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46567/user/jenkins/test-data/74e327d8-fe40-dadc-93fc-96ff3820b37d/testWithMapReduceSingleRegion/22c2305a-eefb-4fb8-a7b4-eea16728e98b 2023-02-16 17:01:55,232 DEBUG [Listener at localhost/40593] util.CommonFSUtils(699): |-data/ 2023-02-16 17:01:55,233 DEBUG [Listener at localhost/40593] util.CommonFSUtils(699): |----default/ 2023-02-16 17:01:55,233 DEBUG [Listener at localhost/40593] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-16 17:01:55,234 DEBUG [Listener at localhost/40593] util.CommonFSUtils(699): |----------fbb112badb86a110fd51ad23f0e3ec18/ 2023-02-16 17:01:55,234 DEBUG [Listener at localhost/40593] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-16 17:01:55,234 DEBUG [Listener at localhost/40593] util.CommonFSUtils(699): |-------------f1/ 2023-02-16 17:01:55,234 DEBUG [Listener at localhost/40593] util.CommonFSUtils(702): |----------------testWithMapReduce=fbb112badb86a110fd51ad23f0e3ec18-1904690687d44fa692b62259d3bc741b 2023-02-16 17:01:55,235 DEBUG [Listener at localhost/40593] util.CommonFSUtils(699): |-------------f2/ 2023-02-16 17:01:55,235 DEBUG [Listener at localhost/40593] util.CommonFSUtils(702): |----------------testWithMapReduce=fbb112badb86a110fd51ad23f0e3ec18-b36d64ee8f5348a6badb3b4c6eff546b 2023-02-16 17:01:55,235 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:55,236 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:55,236 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:55,237 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:56,157 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/hadoop-9061561207656829965.jar 2023-02-16 17:01:56,157 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:56,158 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:56,234 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/hadoop-3064332744129469167.jar 2023-02-16 17:01:56,235 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:56,235 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:56,235 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:56,236 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:56,236 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:56,237 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:56,237 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-16 17:01:56,238 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-16 17:01:56,238 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-16 17:01:56,239 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-16 17:01:56,239 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-16 17:01:56,239 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-16 17:01:56,240 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-16 17:01:56,240 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-16 17:01:56,241 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-16 17:01:56,241 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-16 17:01:56,242 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-16 17:01:56,242 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 17:01:56,242 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 17:01:56,243 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-16 17:01:56,244 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 17:01:56,321 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/hadoop-6771311654987763505.jar 2023-02-16 17:01:56,321 DEBUG [Listener at localhost/40593] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-16 17:01:56,326 WARN [Listener at localhost/40593] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-16 17:01:56,333 WARN [Listener at localhost/40593] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-16 17:01:56,339 INFO [Listener at localhost/40593] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-16 17:01:56,418 WARN [Listener at localhost/40593] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/mapreduce.cluster.local.dir/1676566916384/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-16 17:01:56,418 WARN [Listener at localhost/40593] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/mapreduce.cluster.local.dir/1676566916384/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-16 17:01:56,451 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-16 17:01:56,451 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-16 17:01:56,452 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-16 17:01:56,453 INFO [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:56,454 DEBUG [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/74e327d8-fe40-dadc-93fc-96ff3820b37d/testWithMapReduceSingleRegion/22c2305a-eefb-4fb8-a7b4-eea16728e98b/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1 2023-02-16 17:01:56,455 INFO [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbb112badb86a110fd51ad23f0e3ec18 columnFamilyName f1 2023-02-16 17:01:56,458 DEBUG [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] regionserver.HStore(539): loaded hdfs://localhost:46567/user/jenkins/test-data/74e327d8-fe40-dadc-93fc-96ff3820b37d/testWithMapReduceSingleRegion/22c2305a-eefb-4fb8-a7b4-eea16728e98b/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1/testWithMapReduce=fbb112badb86a110fd51ad23f0e3ec18-1904690687d44fa692b62259d3bc741b 2023-02-16 17:01:56,458 INFO [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] regionserver.HStore(310): Store=fbb112badb86a110fd51ad23f0e3ec18/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:56,459 INFO [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:56,459 DEBUG [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46567/user/jenkins/test-data/74e327d8-fe40-dadc-93fc-96ff3820b37d/testWithMapReduceSingleRegion/22c2305a-eefb-4fb8-a7b4-eea16728e98b/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2 2023-02-16 17:01:56,459 INFO [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbb112badb86a110fd51ad23f0e3ec18 columnFamilyName f2 2023-02-16 17:01:56,463 DEBUG [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] regionserver.HStore(539): loaded hdfs://localhost:46567/user/jenkins/test-data/74e327d8-fe40-dadc-93fc-96ff3820b37d/testWithMapReduceSingleRegion/22c2305a-eefb-4fb8-a7b4-eea16728e98b/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2/testWithMapReduce=fbb112badb86a110fd51ad23f0e3ec18-b36d64ee8f5348a6badb3b4c6eff546b 2023-02-16 17:01:56,463 INFO [StoreOpener-fbb112badb86a110fd51ad23f0e3ec18-1] regionserver.HStore(310): Store=fbb112badb86a110fd51ad23f0e3ec18/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-16 17:01:56,463 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-16 17:01:56,463 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fbb112badb86a110fd51ad23f0e3ec18; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64031203, jitterRate=-0.04586072266101837}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-16 17:01:56,463 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fbb112badb86a110fd51ad23f0e3ec18: 2023-02-16 17:01:56,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fbb112badb86a110fd51ad23f0e3ec18, disabling compactions & flushes 2023-02-16 17:01:56,587 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:56,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:56,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. after waiting 0 ms 2023-02-16 17:01:56,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:56,588 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:56,588 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fbb112badb86a110fd51ad23f0e3ec18: 2023-02-16 17:01:57,455 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-16 17:01:57,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-16 17:01:57,458 INFO [Listener at localhost/40593] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-16 17:01:57,458 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-16 17:01:57,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-16 17:01:57,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 17:01:57,461 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566917461"}]},"ts":"1676566917461"} 2023-02-16 17:01:57,462 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-16 17:01:57,463 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-16 17:01:57,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=fbb112badb86a110fd51ad23f0e3ec18, UNASSIGN}] 2023-02-16 17:01:57,464 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=fbb112badb86a110fd51ad23f0e3ec18, UNASSIGN 2023-02-16 17:01:57,465 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fbb112badb86a110fd51ad23f0e3ec18, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:57,465 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676566917465"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676566917465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676566917465"}]},"ts":"1676566917465"} 2023-02-16 17:01:57,466 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure fbb112badb86a110fd51ad23f0e3ec18, server=jenkins-hbase4.apache.org,46343,1676566912733}] 2023-02-16 17:01:57,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 17:01:57,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:57,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fbb112badb86a110fd51ad23f0e3ec18, disabling compactions & flushes 2023-02-16 17:01:57,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:57,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:57,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. after waiting 0 ms 2023-02-16 17:01:57,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:57,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-16 17:01:57,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18. 2023-02-16 17:01:57,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fbb112badb86a110fd51ad23f0e3ec18: 2023-02-16 17:01:57,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:57,623 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fbb112badb86a110fd51ad23f0e3ec18, regionState=CLOSED 2023-02-16 17:01:57,624 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676566917623"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676566917623"}]},"ts":"1676566917623"} 2023-02-16 17:01:57,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-16 17:01:57,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure fbb112badb86a110fd51ad23f0e3ec18, server=jenkins-hbase4.apache.org,46343,1676566912733 in 159 msec 2023-02-16 17:01:57,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-16 17:01:57,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fbb112badb86a110fd51ad23f0e3ec18, UNASSIGN in 162 msec 2023-02-16 17:01:57,628 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676566917628"}]},"ts":"1676566917628"} 2023-02-16 17:01:57,629 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-16 17:01:57,631 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-16 17:01:57,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 174 msec 2023-02-16 17:01:57,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-16 17:01:57,763 INFO [Listener at localhost/40593] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-16 17:01:57,764 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-16 17:01:57,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-16 17:01:57,766 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 17:01:57,767 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 17:01:57,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 17:01:57,770 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:57,771 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1, FileablePath, hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2, FileablePath, hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/recovered.edits] 2023-02-16 17:01:57,774 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1/1904690687d44fa692b62259d3bc741b to hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/archive/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1/1904690687d44fa692b62259d3bc741b 2023-02-16 17:01:57,775 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1/5e2c8815e0ce48ac8fafd19a9ce30dcc to hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/archive/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f1/5e2c8815e0ce48ac8fafd19a9ce30dcc 2023-02-16 17:01:57,777 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2/20d4ce81ce1a4906bc1b5971c1ed6b7a to hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/archive/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2/20d4ce81ce1a4906bc1b5971c1ed6b7a 2023-02-16 17:01:57,778 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2/b36d64ee8f5348a6badb3b4c6eff546b to hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/archive/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/f2/b36d64ee8f5348a6badb3b4c6eff546b 2023-02-16 17:01:57,780 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/recovered.edits/12.seqid to hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/archive/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18/recovered.edits/12.seqid 2023-02-16 17:01:57,780 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/.tmp/data/default/testWithMapReduce/fbb112badb86a110fd51ad23f0e3ec18 2023-02-16 17:01:57,780 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-16 17:01:57,782 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 17:01:57,783 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-16 17:01:57,785 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-16 17:01:57,786 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 17:01:57,786 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-16 17:01:57,786 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676566917786"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:57,787 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-16 17:01:57,787 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fbb112badb86a110fd51ad23f0e3ec18, NAME => 'testWithMapReduce,,1676566913760.fbb112badb86a110fd51ad23f0e3ec18.', STARTKEY => '', ENDKEY => ''}] 2023-02-16 17:01:57,787 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-16 17:01:57,787 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676566917787"}]},"ts":"9223372036854775807"} 2023-02-16 17:01:57,788 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-16 17:01:57,789 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-16 17:01:57,790 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 26 msec 2023-02-16 17:01:57,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42757] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-16 17:01:57,868 INFO [Listener at localhost/40593] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-16 17:01:57,869 INFO [Listener at localhost/40593] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-16 17:01:57,869 INFO [Listener at localhost/40593] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-16 17:01:57,869 DEBUG [Listener at localhost/40593] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x313de8a4 to 127.0.0.1:57466 2023-02-16 17:01:57,869 DEBUG [Listener at localhost/40593] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:57,869 DEBUG [Listener at localhost/40593] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-16 17:01:57,869 DEBUG [Listener at localhost/40593] util.JVMClusterUtil(257): Found active master hash=461697059, stopped=false 2023-02-16 17:01:57,869 INFO [Listener at localhost/40593] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42757,1676566912675 2023-02-16 17:01:57,871 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:57,871 INFO [Listener at localhost/40593] procedure2.ProcedureExecutor(629): Stopping 2023-02-16 17:01:57,871 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:57,871 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:57,871 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-16 17:01:57,873 DEBUG [Listener at localhost/40593] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07f3a249 to 127.0.0.1:57466 2023-02-16 17:01:57,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:57,873 DEBUG [Listener at localhost/40593] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:57,873 INFO [Listener at localhost/40593] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46445,1676566912712' ***** 2023-02-16 17:01:57,873 INFO [Listener at localhost/40593] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:57,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:57,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-16 17:01:57,874 INFO [RS:0;jenkins-hbase4:46445] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:57,873 INFO [Listener at localhost/40593] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46343,1676566912733' ***** 2023-02-16 17:01:57,874 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:57,874 INFO [Listener at localhost/40593] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-16 17:01:57,874 INFO [RS:0;jenkins-hbase4:46445] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:57,875 INFO [RS:0;jenkins-hbase4:46445] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:57,875 INFO [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(3304): Received CLOSE for 298e1c693ce70e13e480e83bdcec9e8d 2023-02-16 17:01:57,875 INFO [RS:1;jenkins-hbase4:46343] regionserver.HeapMemoryManager(220): Stopping 2023-02-16 17:01:57,875 INFO [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:57,875 INFO [RS:1;jenkins-hbase4:46343] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-16 17:01:57,875 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-16 17:01:57,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 298e1c693ce70e13e480e83bdcec9e8d, disabling compactions & flushes 2023-02-16 17:01:57,875 INFO [RS:1;jenkins-hbase4:46343] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-16 17:01:57,875 DEBUG [RS:0;jenkins-hbase4:46445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60ac5080 to 127.0.0.1:57466 2023-02-16 17:01:57,876 INFO [RS:1;jenkins-hbase4:46343] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:57,876 DEBUG [RS:0;jenkins-hbase4:46445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:57,876 DEBUG [RS:1;jenkins-hbase4:46343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dd4b618 to 127.0.0.1:57466 2023-02-16 17:01:57,876 INFO [RS:0;jenkins-hbase4:46445] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:57,876 INFO [RS:0;jenkins-hbase4:46445] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:57,876 INFO [RS:0;jenkins-hbase4:46445] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:57,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. 2023-02-16 17:01:57,876 INFO [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-16 17:01:57,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. 2023-02-16 17:01:57,876 DEBUG [RS:1;jenkins-hbase4:46343] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:57,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. after waiting 0 ms 2023-02-16 17:01:57,876 INFO [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-16 17:01:57,876 INFO [RS:1;jenkins-hbase4:46343] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46343,1676566912733; all regions closed. 2023-02-16 17:01:57,877 DEBUG [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 298e1c693ce70e13e480e83bdcec9e8d=hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d.} 2023-02-16 17:01:57,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. 2023-02-16 17:01:57,877 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-16 17:01:57,877 DEBUG [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(1505): Waiting on 1588230740, 298e1c693ce70e13e480e83bdcec9e8d 2023-02-16 17:01:57,877 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-16 17:01:57,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 298e1c693ce70e13e480e83bdcec9e8d 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-16 17:01:57,877 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-16 17:01:57,877 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-16 17:01:57,877 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-16 17:01:57,877 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-16 17:01:57,882 DEBUG [RS:1;jenkins-hbase4:46343] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/oldWALs 2023-02-16 17:01:57,882 INFO [RS:1;jenkins-hbase4:46343] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46343%2C1676566912733:(num 1676566914029) 2023-02-16 17:01:57,882 DEBUG [RS:1;jenkins-hbase4:46343] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:57,882 INFO [RS:1;jenkins-hbase4:46343] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:57,883 INFO [RS:1;jenkins-hbase4:46343] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:57,883 INFO [RS:1;jenkins-hbase4:46343] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-16 17:01:57,883 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:57,883 INFO [RS:1;jenkins-hbase4:46343] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-16 17:01:57,883 INFO [RS:1;jenkins-hbase4:46343] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-16 17:01:57,884 INFO [RS:1;jenkins-hbase4:46343] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46343 2023-02-16 17:01:57,885 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:57,885 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:57,885 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46343,1676566912733 2023-02-16 17:01:57,885 ERROR [Listener at localhost/40593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c8cb71d rejected from java.util.concurrent.ThreadPoolExecutor@58b33854[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:57,886 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:57,886 ERROR [Listener at localhost/40593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@15eb1fc7 rejected from java.util.concurrent.ThreadPoolExecutor@58b33854[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:57,885 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:57,886 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46343,1676566912733] 2023-02-16 17:01:57,886 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46343,1676566912733; numProcessing=1 2023-02-16 17:01:57,887 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46343,1676566912733 already deleted, retry=false 2023-02-16 17:01:57,887 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46343,1676566912733 expired; onlineServers=1 2023-02-16 17:01:57,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d/.tmp/info/24ae2dfc2c5242a890943e210f2b7909 2023-02-16 17:01:57,889 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/.tmp/info/edbb63c310b149ceadfff861438b82e8 2023-02-16 17:01:57,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d/.tmp/info/24ae2dfc2c5242a890943e210f2b7909 as hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d/info/24ae2dfc2c5242a890943e210f2b7909 2023-02-16 17:01:57,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for edbb63c310b149ceadfff861438b82e8 2023-02-16 17:01:57,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d/info/24ae2dfc2c5242a890943e210f2b7909, entries=2, sequenceid=6, filesize=4.8 K 2023-02-16 17:01:57,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 298e1c693ce70e13e480e83bdcec9e8d in 20ms, sequenceid=6, compaction requested=false 2023-02-16 17:01:57,899 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/.tmp/rep_barrier/e4e85bba33264ea096f50141609ff30a 2023-02-16 17:01:57,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/namespace/298e1c693ce70e13e480e83bdcec9e8d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-16 17:01:57,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. 2023-02-16 17:01:57,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 298e1c693ce70e13e480e83bdcec9e8d: 2023-02-16 17:01:57,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676566913243.298e1c693ce70e13e480e83bdcec9e8d. 2023-02-16 17:01:57,902 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4e85bba33264ea096f50141609ff30a 2023-02-16 17:01:57,908 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/.tmp/table/ac68642dd5884606aeca381dfce00481 2023-02-16 17:01:57,911 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac68642dd5884606aeca381dfce00481 2023-02-16 17:01:57,911 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:57,911 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:57,913 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/.tmp/info/edbb63c310b149ceadfff861438b82e8 as hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/info/edbb63c310b149ceadfff861438b82e8 2023-02-16 17:01:57,916 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for edbb63c310b149ceadfff861438b82e8 2023-02-16 17:01:57,916 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/info/edbb63c310b149ceadfff861438b82e8, entries=12, sequenceid=21, filesize=6.2 K 2023-02-16 17:01:57,917 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/.tmp/rep_barrier/e4e85bba33264ea096f50141609ff30a as hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/rep_barrier/e4e85bba33264ea096f50141609ff30a 2023-02-16 17:01:57,920 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4e85bba33264ea096f50141609ff30a 2023-02-16 17:01:57,920 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/rep_barrier/e4e85bba33264ea096f50141609ff30a, entries=1, sequenceid=21, filesize=5.0 K 2023-02-16 17:01:57,920 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/.tmp/table/ac68642dd5884606aeca381dfce00481 as hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/table/ac68642dd5884606aeca381dfce00481 2023-02-16 17:01:57,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac68642dd5884606aeca381dfce00481 2023-02-16 17:01:57,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/table/ac68642dd5884606aeca381dfce00481, entries=4, sequenceid=21, filesize=5.0 K 2023-02-16 17:01:57,924 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 47ms, sequenceid=21, compaction requested=false 2023-02-16 17:01:57,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-16 17:01:57,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-16 17:01:57,927 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:57,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-16 17:01:57,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-16 17:01:58,071 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:58,071 INFO [RS:1;jenkins-hbase4:46343] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46343,1676566912733; zookeeper connection closed. 2023-02-16 17:01:58,071 ERROR [Listener at localhost/40593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d569a68 rejected from java.util.concurrent.ThreadPoolExecutor@58b33854[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:58,071 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46343-0x1005e14c8570002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:58,071 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@678c41d6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@678c41d6 2023-02-16 17:01:58,071 ERROR [Listener at localhost/40593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30466f3a rejected from java.util.concurrent.ThreadPoolExecutor@58b33854[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:58,077 INFO [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46445,1676566912712; all regions closed. 2023-02-16 17:01:58,082 DEBUG [RS:0;jenkins-hbase4:46445] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/oldWALs 2023-02-16 17:01:58,082 INFO [RS:0;jenkins-hbase4:46445] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46445%2C1676566912712.meta:.meta(num 1676566913195) 2023-02-16 17:01:58,085 DEBUG [RS:0;jenkins-hbase4:46445] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/oldWALs 2023-02-16 17:01:58,085 INFO [RS:0;jenkins-hbase4:46445] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46445%2C1676566912712:(num 1676566913588) 2023-02-16 17:01:58,086 DEBUG [RS:0;jenkins-hbase4:46445] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:58,086 INFO [RS:0;jenkins-hbase4:46445] regionserver.LeaseManager(133): Closed leases 2023-02-16 17:01:58,086 INFO [RS:0;jenkins-hbase4:46445] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-16 17:01:58,086 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:58,089 INFO [RS:0;jenkins-hbase4:46445] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46445 2023-02-16 17:01:58,097 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46445,1676566912712 2023-02-16 17:01:58,097 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-16 17:01:58,098 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46445,1676566912712] 2023-02-16 17:01:58,098 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46445,1676566912712; numProcessing=2 2023-02-16 17:01:58,099 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46445,1676566912712 already deleted, retry=false 2023-02-16 17:01:58,099 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46445,1676566912712 expired; onlineServers=0 2023-02-16 17:01:58,099 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42757,1676566912675' ***** 2023-02-16 17:01:58,099 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-16 17:01:58,100 DEBUG [M:0;jenkins-hbase4:42757] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fbb778b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-16 17:01:58,100 INFO [M:0;jenkins-hbase4:42757] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42757,1676566912675 2023-02-16 17:01:58,100 INFO [M:0;jenkins-hbase4:42757] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42757,1676566912675; all regions closed. 2023-02-16 17:01:58,100 DEBUG [M:0;jenkins-hbase4:42757] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-16 17:01:58,100 DEBUG [M:0;jenkins-hbase4:42757] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-16 17:01:58,101 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-16 17:01:58,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566912853] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676566912853,5,FailOnTimeoutGroup] 2023-02-16 17:01:58,101 DEBUG [M:0;jenkins-hbase4:42757] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-16 17:01:58,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566912856] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676566912856,5,FailOnTimeoutGroup] 2023-02-16 17:01:58,102 INFO [M:0;jenkins-hbase4:42757] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-16 17:01:58,102 INFO [M:0;jenkins-hbase4:42757] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-16 17:01:58,102 INFO [M:0;jenkins-hbase4:42757] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-16 17:01:58,102 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-16 17:01:58,102 DEBUG [M:0;jenkins-hbase4:42757] master.HMaster(1512): Stopping service threads 2023-02-16 17:01:58,103 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-16 17:01:58,103 INFO [M:0;jenkins-hbase4:42757] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-16 17:01:58,103 ERROR [M:0;jenkins-hbase4:42757] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-16 17:01:58,103 INFO [M:0;jenkins-hbase4:42757] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-16 17:01:58,103 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-16 17:01:58,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-16 17:01:58,104 DEBUG [M:0;jenkins-hbase4:42757] zookeeper.ZKUtil(398): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-16 17:01:58,104 WARN [M:0;jenkins-hbase4:42757] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-16 17:01:58,104 INFO [M:0;jenkins-hbase4:42757] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-16 17:01:58,104 INFO [M:0;jenkins-hbase4:42757] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-16 17:01:58,104 DEBUG [M:0;jenkins-hbase4:42757] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-16 17:01:58,105 INFO [M:0;jenkins-hbase4:42757] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:58,105 DEBUG [M:0;jenkins-hbase4:42757] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:58,105 DEBUG [M:0;jenkins-hbase4:42757] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-16 17:01:58,105 DEBUG [M:0;jenkins-hbase4:42757] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:58,105 INFO [M:0;jenkins-hbase4:42757] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.67 KB heapSize=65.63 KB 2023-02-16 17:01:58,118 INFO [M:0;jenkins-hbase4:42757] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/675447885dae48e180775296fcec0345 2023-02-16 17:01:58,123 DEBUG [M:0;jenkins-hbase4:42757] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/675447885dae48e180775296fcec0345 as hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/675447885dae48e180775296fcec0345 2023-02-16 17:01:58,126 INFO [M:0;jenkins-hbase4:42757] regionserver.HStore(1080): Added hdfs://localhost:46567/user/jenkins/test-data/b192ed1b-1703-7057-18a2-7f012d466698/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/675447885dae48e180775296fcec0345, entries=17, sequenceid=132, filesize=8.6 K 2023-02-16 17:01:58,127 INFO [M:0;jenkins-hbase4:42757] regionserver.HRegion(2947): Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=132, compaction requested=false 2023-02-16 17:01:58,128 INFO [M:0;jenkins-hbase4:42757] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-16 17:01:58,128 DEBUG [M:0;jenkins-hbase4:42757] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-16 17:01:58,134 INFO [M:0;jenkins-hbase4:42757] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-16 17:01:58,134 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-16 17:01:58,134 INFO [M:0;jenkins-hbase4:42757] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42757 2023-02-16 17:01:58,136 DEBUG [M:0;jenkins-hbase4:42757] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42757,1676566912675 already deleted, retry=false 2023-02-16 17:01:58,472 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:58,472 INFO [M:0;jenkins-hbase4:42757] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42757,1676566912675; zookeeper connection closed. 2023-02-16 17:01:58,473 ERROR [Listener at localhost/40593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43d8b8b4 rejected from java.util.concurrent.ThreadPoolExecutor@47e72417[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:58,474 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): master:42757-0x1005e14c8570000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:58,474 ERROR [Listener at localhost/40593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3536b1c3 rejected from java.util.concurrent.ThreadPoolExecutor@47e72417[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:58,573 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:58,573 INFO [RS:0;jenkins-hbase4:46445] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46445,1676566912712; zookeeper connection closed. 2023-02-16 17:01:58,573 ERROR [Listener at localhost/40593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@52239a11 rejected from java.util.concurrent.ThreadPoolExecutor@561c148d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:58,573 DEBUG [Listener at localhost/40593-EventThread] zookeeper.ZKWatcher(600): regionserver:46445-0x1005e14c8570001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-16 17:01:58,573 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@45ed712d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@45ed712d 2023-02-16 17:01:58,573 ERROR [Listener at localhost/40593-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6cfa1e23 rejected from java.util.concurrent.ThreadPoolExecutor@561c148d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-16 17:01:58,573 INFO [Listener at localhost/40593] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-16 17:01:58,573 WARN [Listener at localhost/40593] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:58,586 INFO [Listener at localhost/40593] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:58,653 WARN [BP-1102016702-172.31.14.131-1676566912093 heartbeating to localhost/127.0.0.1:46567] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1102016702-172.31.14.131-1676566912093 (Datanode Uuid 10a3066d-4504-4520-a6f8-da1033be9250) service to localhost/127.0.0.1:46567 2023-02-16 17:01:58,654 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/cluster_67ac2b58-4f98-1cd9-5bc1-e6282e429d8a/dfs/data/data3/current/BP-1102016702-172.31.14.131-1676566912093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:58,654 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/cluster_67ac2b58-4f98-1cd9-5bc1-e6282e429d8a/dfs/data/data4/current/BP-1102016702-172.31.14.131-1676566912093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:58,692 WARN [Listener at localhost/40593] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-16 17:01:58,695 INFO [Listener at localhost/40593] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:58,716 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-16 17:01:58,808 WARN [BP-1102016702-172.31.14.131-1676566912093 heartbeating to localhost/127.0.0.1:46567] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-16 17:01:58,808 WARN [BP-1102016702-172.31.14.131-1676566912093 heartbeating to localhost/127.0.0.1:46567] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1102016702-172.31.14.131-1676566912093 (Datanode Uuid 232b50c9-4039-4d72-9e27-1dc33524b50f) service to localhost/127.0.0.1:46567 2023-02-16 17:01:58,809 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/cluster_67ac2b58-4f98-1cd9-5bc1-e6282e429d8a/dfs/data/data1/current/BP-1102016702-172.31.14.131-1676566912093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:58,809 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a31293af-8f44-f54a-1330-dbefd1390b51/cluster_67ac2b58-4f98-1cd9-5bc1-e6282e429d8a/dfs/data/data2/current/BP-1102016702-172.31.14.131-1676566912093] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-16 17:01:58,821 INFO [Listener at localhost/40593] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-16 17:01:58,941 INFO [Listener at localhost/40593] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-16 17:01:58,963 INFO [Listener at localhost/40593] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-16 17:01:58,979 INFO [Listener at localhost/40593] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=293 (was 273) Potentially hanging thread: Listener at localhost/40593 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:46567 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42757,1676566912675)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:46567 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:46567 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:46567 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:46567 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46567 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:46567 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=602 (was 575) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=366 (was 390), ProcessCount=168 (was 170), AvailableMemoryMB=2127 (was 1103) - AvailableMemoryMB LEAK? -