2023-08-11 04:53:13,265 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-11 04:53:13,587 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-11 04:53:13,708 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-11 04:53:13,767 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-11 04:53:13,776 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-11 04:53:13,791 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=175, AvailableMemoryMB=4703
2023-08-11 04:53:13,794 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-11 04:53:13,794 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-11 04:53:13,943 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1040419682:84 , srv1065473946:84 , srv1073429339:84 , srv1092701257:84 , srv110678575:84 , srv1116946082:84 , srv1121371969:84 , srv1132497277:84 , srv1140365233:84 , srv1141636551:84 , srv1209956536:84 , srv1210553795:84 , srv1217684474:84 , srv1278859793:84 , srv1281368070:84 , srv1286869384:84 , srv1291169341:84 , srv1306314616:84 , srv1307591082:84 , srv1333765458:84 , srv1340335412:84 , srv1378088701:84 , srv139629371:84 , srv139699470:84 , srv1427168923:84 , srv1439909169:84 , srv1477638954:84 , srv1526305913:84 , srv1535874455:84 , srv1560521453:84 , srv1573762053:84 , srv1578183521:84 , srv1589738180:84 , srv1619075676:84 , srv1647128164:84 , srv1654076494:84 , srv1667753994:84 , srv1676814298:84 , srv1681342822:84 , srv1683495194:84 , srv1699697574:84 , srv1731208969:84 , srv1788134431:84 , srv1831346528:84 , srv1874973860:84 , srv1894601832:84 , srv1927108724:84 , srv1948584300:84 , srv1969022640:84 , srv2084601847:84 , srv2108069397:84 , srv211707322:84 , srv220631253:84 , srv226027052:84 , srv244773600:84 , srv26445736:84 , srv27068505:84 , srv273856051:84 , srv284930326:84 , srv338781016:84 , srv356307130:84 , srv361158559:84 , srv363408384:84 , srv373956011:84 , srv405496535:84 , srv416609980:84 , srv431904695:84 , srv442543035:84 , srv447240085:84 , srv478790513:84 , srv479136067:84 , srv489995068:84 , srv495853799:84 , srv499104696:84 , srv516760205:84 , srv53800013:84 , srv542033908:84 , srv543088184:84 , srv544118799:84 , srv56070261:84 , srv59388459:84 , srv626394677:84 , srv647363289:84 , srv658685447:84 , srv663713530:84 , srv712508774:84 , srv727218913:84 , srv733737478:84 , srv794151631:84 , srv795512919:84 , srv818630291:84 , srv832714619:84 , srv846846475:84 , srv86944485:84 , srv871206472:84 , srv879556547:84 , srv898060907:84 , srv974935670:84 , srv99731628:84 , srv1534363321:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-11 04:53:13,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 04:53:13,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1065473946=1, srv1535874455=29, srv1619075676=34, srv1040419682=0, srv211707322=52, srv479136067=71, srv626394677=82, srv1788134431=43, srv1121371969=6, srv1132497277=7, srv1333765458=19, srv1683495194=40, srv818630291=91, srv1286869384=15, srv1378088701=21, srv871206472=95, srv1534363321=28, srv27068505=57, srv478790513=70, srv1831346528=44, srv59388459=81, srv363408384=63, srv879556547=96, srv1573762053=31, srv898060907=97, srv1647128164=35, srv99731628=99, srv1560521453=30, srv447240085=69, srv543088184=78, srv361158559=62, srv244773600=55, srv1681342822=39, srv1699697574=41, srv516760205=75, srv2108069397=51, srv2084601847=50, srv1578183521=32, srv139699470=23, srv1307591082=18, srv489995068=72, srv846846475=93, srv733737478=88, srv26445736=56, srv1092701257=3, srv1281368070=14, srv1927108724=47, srv356307130=61, srv727218913=87, srv139629371=22, srv1874973860=45, srv1894601832=46, srv405496535=65, srv544118799=79, srv1141636551=9, srv86944485=94, srv1209956536=10, srv1278859793=13, srv1667753994=37, srv1969022640=49, srv220631253=53, srv658685447=84, srv1291169341=16, srv974935670=98, srv1948584300=48, srv416609980=66, srv542033908=77, srv1526305913=27, srv1073429339=2, srv1217684474=12, srv56070261=80, srv284930326=59, srv832714619=92, srv1676814298=38, srv795512919=90, srv226027052=54, srv663713530=85, srv338781016=60, srv442543035=68, srv1306314616=17, srv373956011=64, srv1439909169=25, srv712508774=86, srv1589738180=33, srv1654076494=36, srv1210553795=11, srv794151631=89, srv1340335412=20, srv499104696=74, srv1731208969=42, srv647363289=83, srv431904695=67, srv273856051=58, srv1116946082=5, srv1477638954=26, srv53800013=76, srv110678575=4, srv1140365233=8, srv1427168923=24, srv495853799=73} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 04:53:14,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 04:53:14,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 04:53:14,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 04:53:14,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 04:53:14,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 04:53:14,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 04:53:14,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 04:53:14,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 04:53:14,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 04:53:14,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 04:53:14,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 04:53:14,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 04:53:14,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 04:53:14,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 04:53:14,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 04:53:14,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 04:53:14,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 04:53:14,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 04:53:14,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 04:53:14,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 04:53:14,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 04:53:14,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 04:53:14,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 04:53:14,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 04:53:14,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 04:53:14,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 04:53:14,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 04:53:14,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 04:53:14,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 04:53:14,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 04:53:14,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-11 04:53:14,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-11 04:53:14,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-11 04:53:14,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-11 04:53:14,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-11 04:53:14,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-11 04:53:14,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-11 04:53:14,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-11 04:53:14,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-11 04:53:14,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-11 04:53:14,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-11 04:53:14,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-11 04:53:14,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-11 04:53:14,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-11 04:53:14,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-11 04:53:14,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-11 04:53:14,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-11 04:53:14,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-11 04:53:14,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-11 04:53:14,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-11 04:53:14,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-11 04:53:14,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-11 04:53:14,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-11 04:53:14,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-11 04:53:14,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-11 04:53:14,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-11 04:53:14,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-11 04:53:14,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-11 04:53:14,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-11 04:53:14,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-11 04:53:14,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-11 04:53:14,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-11 04:53:14,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-11 04:53:14,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-11 04:53:14,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-11 04:53:14,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-11 04:53:14,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-11 04:53:14,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-11 04:53:14,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-11 04:53:14,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-11 04:53:14,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-11 04:53:14,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-11 04:53:14,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-11 04:53:14,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-11 04:53:14,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-11 04:53:14,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-11 04:53:14,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-11 04:53:14,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-11 04:53:14,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-11 04:53:14,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-11 04:53:14,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-11 04:53:14,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-11 04:53:14,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-11 04:53:14,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-11 04:53:14,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-11 04:53:14,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-11 04:53:14,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-11 04:53:14,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-11 04:53:14,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-11 04:53:14,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-11 04:53:14,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-11 04:53:14,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-11 04:53:14,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-11 04:53:14,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-11 04:53:14,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-11 04:53:14,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-11 04:53:14,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-11 04:53:14,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-11 04:53:14,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-11 04:53:14,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-11 04:53:14,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-11 04:53:14,290 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:53:14,290 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-11 04:53:14,290 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-11 04:53:14,693 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 597 ms to try 5000 different iterations.  Found a solution that moves 4677 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17924610340220634. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04183471536179813, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.059867043109957566, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5196666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04183471536179813, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1745, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24041666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:53:14,731 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1560521453:82 , srv1681342822:82 , srv2108069397:82 , srv818630291:82 , srv1333765458:83 , srv1439909169:83 , srv1526305913:83 , srv1667753994:83 , srv26445736:83 , srv273856051:83 , srv431904695:83 , srv495853799:83 , srv99731628:83 , srv1141636551:84 , srv1307591082:84 , srv139629371:84 , srv1578183521:84 , srv1894601832:84 , srv220631253:84 , srv226027052:84 , srv27068505:84 , srv363408384:84 , srv405496535:84 , srv479136067:84 , srv626394677:84 , srv712508774:84 , srv1278859793:85 , srv1477638954:85 , srv1573762053:85 , srv1647128164:85 , srv1654076494:85 , srv1699697574:85 , srv1874973860:85 , srv499104696:85 , srv542033908:85 , srv647363289:85 , srv86944485:85 , srv871206472:85 , srv1073429339:86 , srv1116946082:86 , srv1121371969:86 , srv1286869384:86 , srv1291169341:86 , srv1427168923:86 , srv1619075676:86 , srv1683495194:86 , srv416609980:86 , srv478790513:86 , srv489995068:86 , srv516760205:86 , srv59388459:86 , srv663713530:86 , srv794151631:86 , srv795512919:86 , srv832714619:86 , srv974935670:86 , srv1065473946:87 , srv1140365233:87 , srv1209956536:87 , srv1217684474:87 , srv139699470:87 , srv1589738180:87 , srv1676814298:87 , srv1731208969:87 , srv211707322:87 , srv338781016:87 , srv356307130:87 , srv361158559:87 , srv373956011:87 , srv56070261:87 , srv727218913:87 , srv733737478:87 , srv1132497277:88 , srv1210553795:88 , srv1306314616:88 , srv1340335412:88 , srv1378088701:88 , srv1535874455:88 , srv1788134431:88 , srv1831346528:88 , srv244773600:88 , srv543088184:88 , srv846846475:88 , srv1927108724:89 , srv442543035:89 , srv447240085:89 , srv53800013:89 , srv544118799:89 , srv879556547:89 , srv1040419682:90 , srv1969022640:90 , srv284930326:90 , srv1092701257:91 , srv1948584300:91 , srv2084601847:91 , srv658685447:91 , srv898060907:91 , srv110678575:92 , srv1281368070:92 , srv1534363321:462 }
2023-08-11 04:53:14,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 04:53:14,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1065473946=1, srv1535874455=29, srv1619075676=34, srv1040419682=0, srv211707322=52, srv479136067=71, srv626394677=82, srv1788134431=43, srv1121371969=6, srv1132497277=7, srv1333765458=19, srv1683495194=40, srv818630291=91, srv1286869384=15, srv1378088701=21, srv871206472=95, srv1534363321=28, srv27068505=57, srv478790513=70, srv1831346528=44, srv59388459=81, srv363408384=63, srv879556547=96, srv1573762053=31, srv898060907=97, srv1647128164=35, srv99731628=99, srv1560521453=30, srv447240085=69, srv543088184=78, srv361158559=62, srv244773600=55, srv1681342822=39, srv1699697574=41, srv516760205=75, srv2108069397=51, srv2084601847=50, srv1578183521=32, srv139699470=23, srv1307591082=18, srv489995068=72, srv846846475=93, srv733737478=88, srv26445736=56, srv1092701257=3, srv1281368070=14, srv1927108724=47, srv356307130=61, srv727218913=87, srv139629371=22, srv1874973860=45, srv1894601832=46, srv405496535=65, srv544118799=79, srv1141636551=9, srv86944485=94, srv1209956536=10, srv1278859793=13, srv1667753994=37, srv1969022640=49, srv220631253=53, srv658685447=84, srv1291169341=16, srv974935670=98, srv1948584300=48, srv416609980=66, srv542033908=77, srv1526305913=27, srv1073429339=2, srv1217684474=12, srv56070261=80, srv284930326=59, srv832714619=92, srv1676814298=38, srv795512919=90, srv226027052=54, srv663713530=85, srv338781016=60, srv442543035=68, srv1306314616=17, srv373956011=64, srv1439909169=25, srv712508774=86, srv1589738180=33, srv1654076494=36, srv1210553795=11, srv794151631=89, srv1340335412=20, srv499104696=74, srv1731208969=42, srv647363289=83, srv431904695=67, srv273856051=58, srv1116946082=5, srv1477638954=26, srv53800013=76, srv110678575=4, srv1140365233=8, srv1427168923=24, srv495853799=73} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 04:53:14,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 04:53:14,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 04:53:14,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 04:53:14,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 04:53:14,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 04:53:14,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 04:53:14,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 04:53:14,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 04:53:14,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 04:53:14,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 04:53:14,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 04:53:14,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 04:53:14,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 04:53:14,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 04:53:14,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 04:53:14,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 04:53:14,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 04:53:14,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 04:53:14,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 04:53:14,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 04:53:14,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 04:53:14,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 04:53:14,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 04:53:14,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 04:53:14,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 04:53:14,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 04:53:14,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 04:53:14,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 04:53:14,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 04:53:14,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 04:53:14,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-11 04:53:14,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-11 04:53:14,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-11 04:53:14,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-11 04:53:14,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-11 04:53:14,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-11 04:53:14,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-11 04:53:14,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-11 04:53:14,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-11 04:53:14,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-11 04:53:14,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-11 04:53:14,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-11 04:53:14,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-11 04:53:14,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-11 04:53:14,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-11 04:53:14,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-11 04:53:14,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-11 04:53:14,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-11 04:53:14,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-11 04:53:14,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-11 04:53:14,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-11 04:53:14,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-11 04:53:14,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-11 04:53:14,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-11 04:53:14,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-11 04:53:14,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-11 04:53:14,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-11 04:53:14,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-11 04:53:14,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-11 04:53:14,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-11 04:53:14,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-11 04:53:14,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-11 04:53:14,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-11 04:53:14,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-11 04:53:14,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-11 04:53:14,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-11 04:53:14,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-11 04:53:14,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-11 04:53:14,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-11 04:53:14,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-11 04:53:14,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-11 04:53:14,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-11 04:53:14,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-11 04:53:14,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-11 04:53:14,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-11 04:53:14,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-11 04:53:14,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-11 04:53:14,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-11 04:53:14,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-11 04:53:14,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-11 04:53:14,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-11 04:53:14,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-11 04:53:14,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-11 04:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-11 04:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-11 04:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-11 04:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-11 04:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-11 04:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-11 04:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-11 04:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-11 04:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-11 04:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-11 04:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-11 04:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-11 04:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-11 04:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-11 04:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-11 04:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-11 04:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-11 04:53:14,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-11 04:53:14,958 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04183471536179813, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.059867043109957566, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04183471536179813, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1745, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24041666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:53:14,959 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-11 04:53:14,959 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17921335434824678, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04183471536179813, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.059867043109957566, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04183471536179813, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1745, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24041666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-11 04:53:15,365 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 561 ms to try 5000 different iterations.  Found a solution that moves 2647 regions; Going from a computed imbalance of 0.17921335434824678 to a new imbalance of 0.0162852029569322. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024074851062312465); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04127866483541876, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2941111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024074851062312465); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0135); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042333333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:53:15,388 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1281368070:78 , srv658685447:79 , srv898060907:79 , srv1092701257:80 , srv110678575:80 , srv1535874455:81 , srv1969022640:81 , srv543088184:81 , srv846846475:81 , srv1040419682:82 , srv1209956536:82 , srv1210553795:82 , srv1948584300:82 , srv2084601847:82 , srv284930326:82 , srv447240085:82 , srv544118799:82 , srv1132497277:83 , srv1140365233:83 , srv1676814298:83 , srv1788134431:83 , srv244773600:83 , srv356307130:83 , srv361158559:83 , srv442543035:83 , srv53800013:83 , srv139699470:84 , srv1573762053:84 , srv1831346528:84 , srv478790513:84 , srv1065473946:85 , srv1116946082:85 , srv1121371969:85 , srv1217684474:85 , srv1306314616:85 , srv1340335412:85 , srv1378088701:85 , srv1589738180:85 , srv1927108724:85 , srv211707322:85 , srv338781016:85 , srv373956011:85 , srv479136067:85 , srv516760205:85 , srv712508774:85 , srv727218913:85 , srv795512919:85 , srv974935670:85 , srv1291169341:86 , srv1427168923:86 , srv1654076494:86 , srv1683495194:86 , srv1874973860:86 , srv499104696:86 , srv56070261:86 , srv647363289:86 , srv871206472:86 , srv879556547:86 , srv1073429339:87 , srv1307591082:87 , srv1477638954:87 , srv1619075676:87 , srv1647128164:87 , srv1731208969:87 , srv416609980:87 , srv626394677:87 , srv663713530:87 , srv832714619:87 , srv1278859793:88 , srv1286869384:88 , srv139629371:88 , srv1526305913:88 , srv1681342822:88 , srv1894601832:88 , srv220631253:88 , srv226027052:88 , srv27068505:88 , srv273856051:88 , srv363408384:88 , srv405496535:88 , srv431904695:88 , srv542033908:88 , srv59388459:88 , srv733737478:88 , srv99731628:88 , srv1141636551:89 , srv1699697574:89 , srv489995068:89 , srv495853799:89 , srv794151631:89 , srv86944485:89 , srv1333765458:90 , srv1439909169:90 , srv1560521453:90 , srv1578183521:90 , srv1667753994:90 , srv26445736:90 , srv2108069397:92 , srv818630291:93 , srv1534363321:526 }
2023-08-11 04:53:15,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 04:53:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1065473946=1, srv1535874455=29, srv1619075676=34, srv1040419682=0, srv211707322=52, srv479136067=71, srv626394677=82, srv1788134431=43, srv1121371969=6, srv1132497277=7, srv1333765458=19, srv1683495194=40, srv818630291=91, srv1286869384=15, srv1378088701=21, srv871206472=95, srv1534363321=28, srv27068505=57, srv478790513=70, srv1831346528=44, srv59388459=81, srv363408384=63, srv879556547=96, srv1573762053=31, srv898060907=97, srv1647128164=35, srv99731628=99, srv1560521453=30, srv447240085=69, srv543088184=78, srv361158559=62, srv244773600=55, srv1681342822=39, srv1699697574=41, srv516760205=75, srv2108069397=51, srv2084601847=50, srv1578183521=32, srv139699470=23, srv1307591082=18, srv489995068=72, srv846846475=93, srv733737478=88, srv26445736=56, srv1092701257=3, srv1281368070=14, srv1927108724=47, srv356307130=61, srv727218913=87, srv139629371=22, srv1874973860=45, srv1894601832=46, srv405496535=65, srv544118799=79, srv1141636551=9, srv86944485=94, srv1209956536=10, srv1278859793=13, srv1667753994=37, srv1969022640=49, srv220631253=53, srv658685447=84, srv1291169341=16, srv974935670=98, srv1948584300=48, srv416609980=66, srv542033908=77, srv1526305913=27, srv1073429339=2, srv1217684474=12, srv56070261=80, srv284930326=59, srv832714619=92, srv1676814298=38, srv795512919=90, srv226027052=54, srv663713530=85, srv338781016=60, srv442543035=68, srv1306314616=17, srv373956011=64, srv1439909169=25, srv712508774=86, srv1589738180=33, srv1654076494=36, srv1210553795=11, srv794151631=89, srv1340335412=20, srv499104696=74, srv1731208969=42, srv647363289=83, srv431904695=67, srv273856051=58, srv1116946082=5, srv1477638954=26, srv53800013=76, srv110678575=4, srv1140365233=8, srv1427168923=24, srv495853799=73} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 04:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 04:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 04:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 04:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 04:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 04:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 04:53:15,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 04:53:15,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 04:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 04:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 04:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 04:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 04:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 04:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 04:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 04:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 04:53:15,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-11 04:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-11 04:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-11 04:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-11 04:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-11 04:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-11 04:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-11 04:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-11 04:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-11 04:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-11 04:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-11 04:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-11 04:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-11 04:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-11 04:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-11 04:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-11 04:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-11 04:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-11 04:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-11 04:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-11 04:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-11 04:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-11 04:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-11 04:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-11 04:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-11 04:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-11 04:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-11 04:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-11 04:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-11 04:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-11 04:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-11 04:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-11 04:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-11 04:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-11 04:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-11 04:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-11 04:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-11 04:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-11 04:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-11 04:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-11 04:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-11 04:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-11 04:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-11 04:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-11 04:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-11 04:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-11 04:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-11 04:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-11 04:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-11 04:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-11 04:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-11 04:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-11 04:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-11 04:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-11 04:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-11 04:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-11 04:53:15,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-11 04:53:15,564 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024074851062312465); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04127866483541876, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024074851062312465); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0135); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042333333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:53:15,565 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-11 04:53:15,565 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01626666826678232, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024074851062312465); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04127866483541876, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024074851062312465); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0135); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042333333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-11 04:53:15,860 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 413 ms to try 5000 different iterations.  Found a solution that moves 994 regions; Going from a computed imbalance of 0.01626666826678232 to a new imbalance of 0.0011184216492183075. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005757280398827387); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00908866414480969); MoveCostFunction : (multiplier=7.0, imbalance=0.11044444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005757280398827387); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=7.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:53:15,862 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv489995068:82 , srv733737478:82 , srv1286869384:83 , srv1578183521:83 , srv1731208969:83 , srv1927108724:83 , srv2108069397:83 , srv59388459:83 , srv818630291:83 , srv879556547:83 , srv1141636551:84 , srv1333765458:84 , srv1340335412:84 , srv1699697574:84 , srv1948584300:84 , srv542033908:84 , srv56070261:84 , srv663713530:84 , srv794151631:84 , srv86944485:84 , srv1073429339:85 , srv110678575:85 , srv1217684474:85 , srv1278859793:85 , srv1291169341:85 , srv1306314616:85 , srv1378088701:85 , srv1427168923:85 , srv1439909169:85 , srv1477638954:85 , srv1619075676:85 , srv1647128164:85 , srv1667753994:85 , srv1683495194:85 , srv2084601847:85 , srv226027052:85 , srv244773600:85 , srv26445736:85 , srv284930326:85 , srv338781016:85 , srv416609980:85 , srv442543035:85 , srv495853799:85 , srv727218913:85 , srv832714619:85 , srv1040419682:86 , srv1065473946:86 , srv1092701257:86 , srv1132497277:86 , srv139629371:86 , srv139699470:86 , srv1526305913:86 , srv1560521453:86 , srv1589738180:86 , srv1654076494:86 , srv1831346528:86 , srv1894601832:86 , srv211707322:86 , srv220631253:86 , srv27068505:86 , srv363408384:86 , srv373956011:86 , srv405496535:86 , srv516760205:86 , srv53800013:86 , srv544118799:86 , srv626394677:86 , srv647363289:86 , srv871206472:86 , srv99731628:86 , srv1116946082:87 , srv1121371969:87 , srv1140365233:87 , srv1210553795:87 , srv1281368070:87 , srv1307591082:87 , srv1676814298:87 , srv1681342822:87 , srv1788134431:87 , srv1874973860:87 , srv1969022640:87 , srv273856051:87 , srv356307130:87 , srv361158559:87 , srv431904695:87 , srv447240085:87 , srv478790513:87 , srv658685447:87 , srv795512919:87 , srv898060907:87 , srv974935670:87 , srv1573762053:88 , srv499104696:88 , srv846846475:88 , srv1209956536:89 , srv1535874455:89 , srv479136067:89 , srv543088184:89 , srv712508774:89 , srv1534363321:521 }
2023-08-11 04:53:15,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 04:53:15,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1065473946=1, srv1535874455=29, srv1619075676=34, srv1040419682=0, srv211707322=52, srv479136067=71, srv626394677=82, srv1788134431=43, srv1121371969=6, srv1132497277=7, srv1333765458=19, srv1683495194=40, srv818630291=91, srv1286869384=15, srv1378088701=21, srv871206472=95, srv1534363321=28, srv27068505=57, srv478790513=70, srv1831346528=44, srv59388459=81, srv363408384=63, srv879556547=96, srv1573762053=31, srv898060907=97, srv1647128164=35, srv99731628=99, srv1560521453=30, srv447240085=69, srv543088184=78, srv361158559=62, srv244773600=55, srv1681342822=39, srv1699697574=41, srv516760205=75, srv2108069397=51, srv2084601847=50, srv1578183521=32, srv139699470=23, srv1307591082=18, srv489995068=72, srv846846475=93, srv733737478=88, srv26445736=56, srv1092701257=3, srv1281368070=14, srv1927108724=47, srv356307130=61, srv727218913=87, srv139629371=22, srv1874973860=45, srv1894601832=46, srv405496535=65, srv544118799=79, srv1141636551=9, srv86944485=94, srv1209956536=10, srv1278859793=13, srv1667753994=37, srv1969022640=49, srv220631253=53, srv658685447=84, srv1291169341=16, srv974935670=98, srv1948584300=48, srv416609980=66, srv542033908=77, srv1526305913=27, srv1073429339=2, srv1217684474=12, srv56070261=80, srv284930326=59, srv832714619=92, srv1676814298=38, srv795512919=90, srv226027052=54, srv663713530=85, srv338781016=60, srv442543035=68, srv1306314616=17, srv373956011=64, srv1439909169=25, srv712508774=86, srv1589738180=33, srv1654076494=36, srv1210553795=11, srv794151631=89, srv1340335412=20, srv499104696=74, srv1731208969=42, srv647363289=83, srv431904695=67, srv273856051=58, srv1116946082=5, srv1477638954=26, srv53800013=76, srv110678575=4, srv1140365233=8, srv1427168923=24, srv495853799=73} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 04:53:15,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 04:53:15,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 04:53:15,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 04:53:15,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 04:53:15,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 04:53:15,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 04:53:15,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 04:53:15,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 04:53:15,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 04:53:15,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 04:53:15,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 04:53:15,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 04:53:15,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 04:53:15,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 04:53:15,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 04:53:15,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 04:53:15,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 04:53:15,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 04:53:15,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 04:53:15,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 04:53:15,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 04:53:15,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 04:53:15,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 04:53:15,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 04:53:15,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 04:53:15,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 04:53:15,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 04:53:15,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 04:53:15,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 04:53:15,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 04:53:15,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-11 04:53:15,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-11 04:53:15,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-11 04:53:15,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-11 04:53:15,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-11 04:53:15,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-11 04:53:15,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-11 04:53:15,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-11 04:53:15,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-11 04:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-11 04:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-11 04:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-11 04:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-11 04:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-11 04:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-11 04:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-11 04:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-11 04:53:15,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-11 04:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-11 04:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-11 04:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-11 04:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-11 04:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-11 04:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-11 04:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-11 04:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-11 04:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-11 04:53:15,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-11 04:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-11 04:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-11 04:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-11 04:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-11 04:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-11 04:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-11 04:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-11 04:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-11 04:53:15,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-11 04:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-11 04:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-11 04:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-11 04:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-11 04:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-11 04:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-11 04:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-11 04:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-11 04:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-11 04:53:15,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-11 04:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-11 04:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-11 04:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-11 04:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-11 04:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-11 04:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-11 04:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-11 04:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-11 04:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-11 04:53:15,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-11 04:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-11 04:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-11 04:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-11 04:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-11 04:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-11 04:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-11 04:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-11 04:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-11 04:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-11 04:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-11 04:53:15,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-11 04:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-11 04:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-11 04:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-11 04:53:16,049 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005757280398827387); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00908866414480969); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005757280398827387); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=7.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:53:16,050 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-11 04:53:16,050 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0011114615124563215, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005757280398827387); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00908866414480969); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005757280398827387); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=7.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-11 04:53:16,602 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 691 ms to try 5000 different iterations.  Found a solution that moves 285 regions; Going from a computed imbalance of 0.0011114615124563215 to a new imbalance of 2.845372180604626E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.03166666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:53:16,604 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1831346528:83 , srv211707322:83 , srv53800013:83 , srv794151631:83 , srv1040419682:84 , srv1065473946:84 , srv1073429339:84 , srv1116946082:84 , srv1121371969:84 , srv1209956536:84 , srv1306314616:84 , srv1307591082:84 , srv1378088701:84 , srv139629371:84 , srv1427168923:84 , srv1477638954:84 , srv1535874455:84 , srv1560521453:84 , srv1619075676:84 , srv1667753994:84 , srv1788134431:84 , srv1874973860:84 , srv1894601832:84 , srv1969022640:84 , srv2084601847:84 , srv220631253:84 , srv26445736:84 , srv27068505:84 , srv273856051:84 , srv363408384:84 , srv373956011:84 , srv405496535:84 , srv416609980:84 , srv442543035:84 , srv447240085:84 , srv479136067:84 , srv499104696:84 , srv516760205:84 , srv543088184:84 , srv544118799:84 , srv56070261:84 , srv712508774:84 , srv733737478:84 , srv795512919:84 , srv832714619:84 , srv879556547:84 , srv974935670:84 , srv1092701257:85 , srv110678575:85 , srv1132497277:85 , srv1141636551:85 , srv1210553795:85 , srv1217684474:85 , srv1278859793:85 , srv1281368070:85 , srv1286869384:85 , srv1291169341:85 , srv1333765458:85 , srv1340335412:85 , srv139699470:85 , srv1439909169:85 , srv1526305913:85 , srv1573762053:85 , srv1578183521:85 , srv1589738180:85 , srv1647128164:85 , srv1654076494:85 , srv1676814298:85 , srv1681342822:85 , srv1683495194:85 , srv1699697574:85 , srv1731208969:85 , srv1927108724:85 , srv1948584300:85 , srv2108069397:85 , srv284930326:85 , srv338781016:85 , srv356307130:85 , srv361158559:85 , srv431904695:85 , srv478790513:85 , srv489995068:85 , srv495853799:85 , srv542033908:85 , srv59388459:85 , srv626394677:85 , srv647363289:85 , srv658685447:85 , srv663713530:85 , srv727218913:85 , srv818630291:85 , srv846846475:85 , srv86944485:85 , srv871206472:85 , srv898060907:85 , srv99731628:85 , srv1140365233:86 , srv226027052:86 , srv244773600:86 , srv1534363321:633 }
2023-08-11 04:53:16,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 04:53:16,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1065473946=1, srv1535874455=29, srv1619075676=34, srv1040419682=0, srv211707322=52, srv479136067=71, srv626394677=82, srv1788134431=43, srv1121371969=6, srv1132497277=7, srv1333765458=19, srv1683495194=40, srv818630291=91, srv1286869384=15, srv1378088701=21, srv871206472=95, srv1534363321=28, srv27068505=57, srv478790513=70, srv1831346528=44, srv59388459=81, srv363408384=63, srv879556547=96, srv1573762053=31, srv898060907=97, srv1647128164=35, srv99731628=99, srv1560521453=30, srv447240085=69, srv543088184=78, srv361158559=62, srv244773600=55, srv1681342822=39, srv1699697574=41, srv516760205=75, srv2108069397=51, srv2084601847=50, srv1578183521=32, srv139699470=23, srv1307591082=18, srv489995068=72, srv846846475=93, srv733737478=88, srv26445736=56, srv1092701257=3, srv1281368070=14, srv1927108724=47, srv356307130=61, srv727218913=87, srv139629371=22, srv1874973860=45, srv1894601832=46, srv405496535=65, srv544118799=79, srv1141636551=9, srv86944485=94, srv1209956536=10, srv1278859793=13, srv1667753994=37, srv1969022640=49, srv220631253=53, srv658685447=84, srv1291169341=16, srv974935670=98, srv1948584300=48, srv416609980=66, srv542033908=77, srv1526305913=27, srv1073429339=2, srv1217684474=12, srv56070261=80, srv284930326=59, srv832714619=92, srv1676814298=38, srv795512919=90, srv226027052=54, srv663713530=85, srv338781016=60, srv442543035=68, srv1306314616=17, srv373956011=64, srv1439909169=25, srv712508774=86, srv1589738180=33, srv1654076494=36, srv1210553795=11, srv794151631=89, srv1340335412=20, srv499104696=74, srv1731208969=42, srv647363289=83, srv431904695=67, srv273856051=58, srv1116946082=5, srv1477638954=26, srv53800013=76, srv110678575=4, srv1140365233=8, srv1427168923=24, srv495853799=73} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 04:53:16,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 04:53:16,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 04:53:16,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 04:53:16,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 04:53:16,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 04:53:16,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 04:53:16,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 04:53:16,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 04:53:16,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 04:53:16,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 04:53:16,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 04:53:16,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 04:53:16,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 04:53:16,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 04:53:16,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 04:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 04:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 04:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 04:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 04:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 04:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 04:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 04:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 04:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 04:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 04:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 04:53:16,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 04:53:16,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 04:53:16,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 04:53:16,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 04:53:16,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-11 04:53:16,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-11 04:53:16,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-11 04:53:16,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-11 04:53:16,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-11 04:53:16,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-11 04:53:16,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-11 04:53:16,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-11 04:53:16,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-11 04:53:16,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-11 04:53:16,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-11 04:53:16,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-11 04:53:16,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-11 04:53:16,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-11 04:53:16,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-11 04:53:16,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-11 04:53:16,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-11 04:53:16,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-11 04:53:16,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-11 04:53:16,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-11 04:53:16,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-11 04:53:16,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-11 04:53:16,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-11 04:53:16,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-11 04:53:16,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-11 04:53:16,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-11 04:53:16,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-11 04:53:16,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-11 04:53:16,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-11 04:53:16,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-11 04:53:16,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-11 04:53:16,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-11 04:53:16,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-11 04:53:16,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-11 04:53:16,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-11 04:53:16,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-11 04:53:16,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-11 04:53:16,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-11 04:53:16,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-11 04:53:16,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-11 04:53:16,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-11 04:53:16,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-11 04:53:16,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-11 04:53:16,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-11 04:53:16,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-11 04:53:16,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-11 04:53:16,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-11 04:53:16,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-11 04:53:16,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-11 04:53:16,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-11 04:53:16,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-11 04:53:16,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-11 04:53:16,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-11 04:53:16,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-11 04:53:16,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-11 04:53:16,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-11 04:53:16,781 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:53:16,782 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-11 04:53:16,782 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.6458109152961765E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-11 04:53:17,153 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 491 ms to try 5000 different iterations.  Found a solution that moves 34 regions; Going from a computed imbalance of 2.6458109152961765E-5 to a new imbalance of 6.6360587607078495E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.003777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:53:17,154 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1140365233:83 , srv1278859793:83 , srv1439909169:83 , srv1589738180:83 , srv1699697574:83 , srv226027052:83 , srv431904695:83 , srv499104696:83 , srv818630291:83 , srv86944485:83 , srv1040419682:84 , srv1065473946:84 , srv1073429339:84 , srv1092701257:84 , srv110678575:84 , srv1116946082:84 , srv1121371969:84 , srv1132497277:84 , srv1141636551:84 , srv1209956536:84 , srv1210553795:84 , srv1217684474:84 , srv1281368070:84 , srv1286869384:84 , srv1291169341:84 , srv1306314616:84 , srv1307591082:84 , srv1333765458:84 , srv1340335412:84 , srv1378088701:84 , srv139629371:84 , srv139699470:84 , srv1526305913:84 , srv1535874455:84 , srv1560521453:84 , srv1573762053:84 , srv1578183521:84 , srv1619075676:84 , srv1647128164:84 , srv1654076494:84 , srv1667753994:84 , srv1676814298:84 , srv1681342822:84 , srv1683495194:84 , srv1731208969:84 , srv1788134431:84 , srv1874973860:84 , srv1894601832:84 , srv1927108724:84 , srv1948584300:84 , srv1969022640:84 , srv2084601847:84 , srv2108069397:84 , srv220631253:84 , srv244773600:84 , srv26445736:84 , srv27068505:84 , srv273856051:84 , srv284930326:84 , srv338781016:84 , srv356307130:84 , srv361158559:84 , srv363408384:84 , srv373956011:84 , srv405496535:84 , srv416609980:84 , srv447240085:84 , srv478790513:84 , srv479136067:84 , srv489995068:84 , srv495853799:84 , srv542033908:84 , srv543088184:84 , srv59388459:84 , srv626394677:84 , srv647363289:84 , srv658685447:84 , srv663713530:84 , srv712508774:84 , srv727218913:84 , srv794151631:84 , srv795512919:84 , srv832714619:84 , srv846846475:84 , srv871206472:84 , srv879556547:84 , srv898060907:84 , srv974935670:84 , srv99731628:84 , srv1427168923:85 , srv1477638954:85 , srv1831346528:85 , srv211707322:85 , srv442543035:85 , srv516760205:85 , srv53800013:85 , srv544118799:85 , srv56070261:85 , srv733737478:85 , srv1534363321:684 }
2023-08-11 04:53:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 04:53:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1065473946=1, srv1535874455=29, srv1619075676=34, srv1040419682=0, srv211707322=52, srv479136067=71, srv626394677=82, srv1788134431=43, srv1121371969=6, srv1132497277=7, srv1333765458=19, srv1683495194=40, srv818630291=91, srv1286869384=15, srv1378088701=21, srv871206472=95, srv1534363321=28, srv27068505=57, srv478790513=70, srv1831346528=44, srv59388459=81, srv363408384=63, srv879556547=96, srv1573762053=31, srv898060907=97, srv1647128164=35, srv99731628=99, srv1560521453=30, srv447240085=69, srv543088184=78, srv361158559=62, srv244773600=55, srv1681342822=39, srv1699697574=41, srv516760205=75, srv2108069397=51, srv2084601847=50, srv1578183521=32, srv139699470=23, srv1307591082=18, srv489995068=72, srv846846475=93, srv733737478=88, srv26445736=56, srv1092701257=3, srv1281368070=14, srv1927108724=47, srv356307130=61, srv727218913=87, srv139629371=22, srv1874973860=45, srv1894601832=46, srv405496535=65, srv544118799=79, srv1141636551=9, srv86944485=94, srv1209956536=10, srv1278859793=13, srv1667753994=37, srv1969022640=49, srv220631253=53, srv658685447=84, srv1291169341=16, srv974935670=98, srv1948584300=48, srv416609980=66, srv542033908=77, srv1526305913=27, srv1073429339=2, srv1217684474=12, srv56070261=80, srv284930326=59, srv832714619=92, srv1676814298=38, srv795512919=90, srv226027052=54, srv663713530=85, srv338781016=60, srv442543035=68, srv1306314616=17, srv373956011=64, srv1439909169=25, srv712508774=86, srv1589738180=33, srv1654076494=36, srv1210553795=11, srv794151631=89, srv1340335412=20, srv499104696=74, srv1731208969=42, srv647363289=83, srv431904695=67, srv273856051=58, srv1116946082=5, srv1477638954=26, srv53800013=76, srv110678575=4, srv1140365233=8, srv1427168923=24, srv495853799=73} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 04:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 04:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 04:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 04:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 04:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 04:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 04:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 04:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 04:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-11 04:53:17,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-11 04:53:17,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-11 04:53:17,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-11 04:53:17,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-11 04:53:17,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-11 04:53:17,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-11 04:53:17,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-11 04:53:17,322 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:53:17,322 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1140365233:83 , srv1278859793:83 , srv1439909169:83 , srv1589738180:83 , srv1699697574:83 , srv226027052:83 , srv431904695:83 , srv499104696:83 , srv818630291:83 , srv86944485:83 , srv1040419682:84 , srv1065473946:84 , srv1073429339:84 , srv1092701257:84 , srv110678575:84 , srv1116946082:84 , srv1121371969:84 , srv1132497277:84 , srv1141636551:84 , srv1209956536:84 , srv1210553795:84 , srv1217684474:84 , srv1281368070:84 , srv1286869384:84 , srv1291169341:84 , srv1306314616:84 , srv1307591082:84 , srv1333765458:84 , srv1340335412:84 , srv1378088701:84 , srv139629371:84 , srv139699470:84 , srv1526305913:84 , srv1535874455:84 , srv1560521453:84 , srv1573762053:84 , srv1578183521:84 , srv1619075676:84 , srv1647128164:84 , srv1654076494:84 , srv1667753994:84 , srv1676814298:84 , srv1681342822:84 , srv1683495194:84 , srv1731208969:84 , srv1788134431:84 , srv1874973860:84 , srv1894601832:84 , srv1927108724:84 , srv1948584300:84 , srv1969022640:84 , srv2084601847:84 , srv2108069397:84 , srv220631253:84 , srv244773600:84 , srv26445736:84 , srv27068505:84 , srv273856051:84 , srv284930326:84 , srv338781016:84 , srv356307130:84 , srv361158559:84 , srv363408384:84 , srv373956011:84 , srv405496535:84 , srv416609980:84 , srv447240085:84 , srv478790513:84 , srv479136067:84 , srv489995068:84 , srv495853799:84 , srv542033908:84 , srv543088184:84 , srv59388459:84 , srv626394677:84 , srv647363289:84 , srv658685447:84 , srv663713530:84 , srv712508774:84 , srv727218913:84 , srv794151631:84 , srv795512919:84 , srv832714619:84 , srv846846475:84 , srv871206472:84 , srv879556547:84 , srv898060907:84 , srv974935670:84 , srv99731628:84 , srv1427168923:85 , srv1477638954:85 , srv1831346528:85 , srv211707322:85 , srv442543035:85 , srv516760205:85 , srv53800013:85 , srv544118799:85 , srv56070261:85 , srv733737478:85 , srv1534363321:684 }
2023-08-11 04:53:17,356 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 266), ProcessCount=175 (was 175), AvailableMemoryMB=3821 (was 4703)
2023-08-11 04:53:17,367 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=175, AvailableMemoryMB=3820
2023-08-11 04:53:17,367 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-11 04:53:17,368 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-11 04:53:17,379 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1063260835:84 , srv1208413778:84 , srv1217514735:84 , srv1221883432:84 , srv1267940719:84 , srv1274626:84 , srv1277116436:84 , srv1400542300:84 , srv1408190907:84 , srv1448461324:84 , srv1670347556:84 , srv1746341077:84 , srv1759442176:84 , srv1823278745:84 , srv1896981984:84 , srv2003312488:84 , srv2033501806:84 , srv2064688633:84 , srv2122019221:84 , srv417690572:84 , srv454352264:84 , srv599936969:84 , srv660924703:84 , srv671474405:84 , srv692213488:84 , srv740184329:84 , srv879777278:84 , srv896185313:84 , srv986987365:84 , srv1495656975:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-11 04:53:17,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 04:53:17,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1221883432=3, srv1063260835=0, srv1208413778=1, srv879777278=27, srv454352264=21, srv660924703=23, srv1823278745=14, srv1746341077=12, srv896185313=28, srv1495656975=10, srv1408190907=8, srv986987365=29, srv1267940719=4, srv1274626=5, srv599936969=22, srv1217514735=2, srv1400542300=7, srv1759442176=13, srv2033501806=17, srv2003312488=16, srv740184329=26, srv1896981984=15, srv417690572=20, srv2064688633=18, srv2122019221=19, srv1277116436=6, srv1448461324=9, srv671474405=24, srv1670347556=11, srv692213488=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 04:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 04:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 04:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 04:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 04:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 04:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 04:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 04:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 04:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 04:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 04:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 04:53:17,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 04:53:17,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 04:53:17,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 04:53:17,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 04:53:17,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 04:53:17,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-11 04:53:17,420 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1011217143813687, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:53:17,421 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912511674484368, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1011217143813687, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-11 04:55:17,399 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5570557 different iterations.  Found a solution that moves 1861 regions; Going from a computed imbalance of 0.9912511674484368 to a new imbalance of 4.3436668390529226E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6892592592592592, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:55:17,407 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1063260835:90 , srv1208413778:90 , srv1217514735:90 , srv1221883432:90 , srv1267940719:90 , srv1274626:90 , srv1277116436:90 , srv1400542300:90 , srv1408190907:90 , srv1448461324:90 , srv1495656975:90 , srv1670347556:90 , srv1746341077:90 , srv1759442176:90 , srv1823278745:90 , srv1896981984:90 , srv2003312488:90 , srv2033501806:90 , srv2064688633:90 , srv2122019221:90 , srv417690572:90 , srv454352264:90 , srv599936969:90 , srv660924703:90 , srv671474405:90 , srv692213488:90 , srv740184329:90 , srv879777278:90 , srv896185313:90 , srv986987365:90 }
2023-08-11 04:55:17,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-11 04:55:17,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1221883432=3, srv1063260835=0, srv1208413778=1, srv879777278=27, srv454352264=21, srv660924703=23, srv1823278745=14, srv1746341077=12, srv896185313=28, srv1495656975=10, srv1408190907=8, srv986987365=29, srv1267940719=4, srv1274626=5, srv599936969=22, srv1217514735=2, srv1400542300=7, srv1759442176=13, srv2033501806=17, srv2003312488=16, srv740184329=26, srv1896981984=15, srv417690572=20, srv2064688633=18, srv2122019221=19, srv1277116436=6, srv1448461324=9, srv671474405=24, srv1670347556=11, srv692213488=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-11 04:55:17,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-11 04:55:17,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-11 04:55:17,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-11 04:55:17,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-11 04:55:17,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-11 04:55:17,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-11 04:55:17,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-11 04:55:17,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-11 04:55:17,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-11 04:55:17,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-11 04:55:17,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-11 04:55:17,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-11 04:55:17,415 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-11 04:55:17,432 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-11 04:55:17,432 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1063260835:90 , srv1208413778:90 , srv1217514735:90 , srv1221883432:90 , srv1267940719:90 , srv1274626:90 , srv1277116436:90 , srv1400542300:90 , srv1408190907:90 , srv1448461324:90 , srv1495656975:90 , srv1670347556:90 , srv1746341077:90 , srv1759442176:90 , srv1823278745:90 , srv1896981984:90 , srv2003312488:90 , srv2033501806:90 , srv2064688633:90 , srv2122019221:90 , srv417690572:90 , srv454352264:90 , srv599936969:90 , srv660924703:90 , srv671474405:90 , srv692213488:90 , srv740184329:90 , srv879777278:90 , srv896185313:90 , srv986987365:90 }
2023-08-11 04:55:17,448 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=248 (was 266), ProcessCount=175 (was 175), AvailableMemoryMB=3680 (was 3820)