2023-03-16 04:53:57,414 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-16 04:53:57,730 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-16 04:53:57,838 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-16 04:53:57,895 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-16 04:53:57,902 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-16 04:53:57,916 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=408, ProcessCount=169, AvailableMemoryMB=6896
2023-03-16 04:53:57,918 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-16 04:53:57,918 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-16 04:53:58,040 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1001623692:84 , srv1017731432:84 , srv1030418689:84 , srv1043002951:84 , srv1045015180:84 , srv1072157415:84 , srv1088961078:84 , srv108936306:84 , srv1119188562:84 , srv1166938823:84 , srv1182899518:84 , srv118843441:84 , srv1234261136:84 , srv1244635436:84 , srv1256557521:84 , srv1280127442:84 , srv1287708701:84 , srv1309098623:84 , srv1309562740:84 , srv1315989177:84 , srv1321189450:84 , srv1324294386:84 , srv1348432602:84 , srv1369016231:84 , srv1408097169:84 , srv1439631828:84 , srv1459705741:84 , srv1470983896:84 , srv1474999691:84 , srv1546430311:84 , srv1547874343:84 , srv158496897:84 , srv1589883948:84 , srv1595501161:84 , srv160032734:84 , srv1606773059:84 , srv1624626229:84 , srv162521149:84 , srv1661140118:84 , srv1668967590:84 , srv167935963:84 , srv1701246523:84 , srv17549821:84 , srv1792596248:84 , srv1820728867:84 , srv1842116177:84 , srv1850034324:84 , srv1851856173:84 , srv1857661559:84 , srv1868120455:84 , srv1876017828:84 , srv1880640485:84 , srv1885731540:84 , srv1915331306:84 , srv199667904:84 , srv2030652539:84 , srv2049470212:84 , srv2117907644:84 , srv2137562587:84 , srv2143993783:84 , srv2146151222:84 , srv219898665:84 , srv220429606:84 , srv231458794:84 , srv252386941:84 , srv274301784:84 , srv276071565:84 , srv276415232:84 , srv284483831:84 , srv292193157:84 , srv33065458:84 , srv342416073:84 , srv349649032:84 , srv392851620:84 , srv412290988:84 , srv478655885:84 , srv486441100:84 , srv49987789:84 , srv510921125:84 , srv515764198:84 , srv547616622:84 , srv585913571:84 , srv648622440:84 , srv691770818:84 , srv709464743:84 , srv751179767:84 , srv787107637:84 , srv791510777:84 , srv828121330:84 , srv851680923:84 , srv858299044:84 , srv871265559:84 , srv906395882:84 , srv911834638:84 , srv917165220:84 , srv918940416:84 , srv926390624:84 , srv941143952:84 , srv941706269:84 , srv1724355262:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-16 04:53:58,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-16 04:53:58,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1470983896=27, srv1885731540=53, srv1256557521=14, srv1182899518=10, srv219898665=62, srv118843441=11, srv1088961078=6, srv1244635436=13, srv1017731432=1, srv412290988=75, srv1234261136=12, srv478655885=76, srv1321189450=20, srv941143952=98, srv1408097169=24, srv926390624=97, srv858299044=91, srv1606773059=35, srv1547874343=30, srv1459705741=26, srv276415232=68, srv1119188562=8, srv160032734=34, srv167935963=40, srv906395882=93, srv2117907644=58, srv1546430311=29, srv1043002951=3, srv1850034324=47, srv1624626229=36, srv787107637=87, srv1309562740=18, srv1045015180=4, srv871265559=92, srv49987789=78, srv547616622=81, srv199667904=55, srv709464743=85, srv791510777=88, srv1868120455=50, srv691770818=84, srv1309098623=17, srv1315989177=19, srv1661140118=38, srv1876017828=51, srv349649032=73, srv158496897=31, srv33065458=71, srv342416073=72, srv1474999691=28, srv274301784=66, srv1724355262=42, srv1792596248=44, srv911834638=94, srv1820728867=45, srv2146151222=61, srv1001623692=0, srv2030652539=56, srv2049470212=57, srv585913571=82, srv1287708701=16, srv941706269=99, srv1701246523=41, srv648622440=83, srv1668967590=39, srv220429606=63, srv515764198=80, srv918940416=96, srv1439631828=25, srv17549821=43, srv1166938823=9, srv1030418689=2, srv1857661559=49, srv1280127442=15, srv1324294386=21, srv828121330=89, srv162521149=37, srv1842116177=46, srv292193157=70, srv1915331306=54, srv284483831=69, srv392851620=74, srv2143993783=60, srv2137562587=59, srv1589883948=32, srv486441100=77, srv231458794=64, srv751179767=86, srv1851856173=48, srv108936306=7, srv1072157415=5, srv1348432602=22, srv276071565=67, srv851680923=90, srv510921125=79, srv917165220=95, srv252386941=65, srv1595501161=33, srv1880640485=52, srv1369016231=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-16 04:53:58,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-16 04:53:58,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-16 04:53:58,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-16 04:53:58,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-16 04:53:58,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-16 04:53:58,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-16 04:53:58,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-16 04:53:58,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-16 04:53:58,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-16 04:53:58,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-16 04:53:58,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-16 04:53:58,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-16 04:53:58,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-16 04:53:58,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-16 04:53:58,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-16 04:53:58,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-16 04:53:58,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-16 04:53:58,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-16 04:53:58,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-16 04:53:58,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-16 04:53:58,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-16 04:53:58,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-16 04:53:58,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-16 04:53:58,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-16 04:53:58,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-16 04:53:58,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-16 04:53:58,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-16 04:53:58,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-16 04:53:58,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-16 04:53:58,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-16 04:53:58,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-16 04:53:58,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-16 04:53:58,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-16 04:53:58,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-16 04:53:58,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-16 04:53:58,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-16 04:53:58,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-16 04:53:58,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-16 04:53:58,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-16 04:53:58,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-16 04:53:58,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-16 04:53:58,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-16 04:53:58,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-16 04:53:58,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-16 04:53:58,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-16 04:53:58,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-16 04:53:58,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-16 04:53:58,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-16 04:53:58,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-16 04:53:58,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-16 04:53:58,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-16 04:53:58,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-16 04:53:58,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-16 04:53:58,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-16 04:53:58,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-16 04:53:58,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-16 04:53:58,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-16 04:53:58,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-16 04:53:58,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-16 04:53:58,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-16 04:53:58,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-16 04:53:58,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-16 04:53:58,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-16 04:53:58,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-16 04:53:58,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-16 04:53:58,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-16 04:53:58,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-16 04:53:58,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-16 04:53:58,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-16 04:53:58,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-16 04:53:58,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-16 04:53:58,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-16 04:53:58,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-16 04:53:58,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-16 04:53:58,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-16 04:53:58,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-16 04:53:58,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-16 04:53:58,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-16 04:53:58,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-16 04:53:58,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-16 04:53:58,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-16 04:53:58,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-16 04:53:58,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-16 04:53:58,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-16 04:53:58,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-16 04:53:58,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-16 04:53:58,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-16 04:53:58,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-16 04:53:58,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-16 04:53:58,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-16 04:53:58,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-16 04:53:58,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-16 04:53:58,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-16 04:53:58,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-16 04:53:58,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-16 04:53:58,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-16 04:53:58,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-16 04:53:58,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-16 04:53:58,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-16 04:53:58,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-16 04:53:58,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-16 04:53:58,442 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:53:58,443 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-16 04:53:58,443 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-16 04:53:58,808 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 616 ms to try 5000 different iterations.  Found a solution that moves 4697 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18043740715374765. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036961539212676135, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056369790764971305, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5218888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.036961539212676135, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17591666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23991666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:53:58,829 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1589883948:80 , srv118843441:81 , srv276415232:81 , srv486441100:82 , srv1017731432:83 , srv1119188562:83 , srv1408097169:83 , srv1851856173:83 , srv2137562587:83 , srv252386941:83 , srv851680923:83 , srv1072157415:84 , srv1624626229:84 , srv162521149:84 , srv1661140118:84 , srv1820728867:84 , srv2049470212:84 , srv510921125:84 , srv691770818:84 , srv858299044:84 , srv871265559:84 , srv911834638:84 , srv918940416:84 , srv1088961078:85 , srv1234261136:85 , srv1244635436:85 , srv1287708701:85 , srv1309098623:85 , srv1309562740:85 , srv1546430311:85 , srv1668967590:85 , srv17549821:85 , srv199667904:85 , srv33065458:85 , srv349649032:85 , srv547616622:85 , srv828121330:85 , srv1256557521:86 , srv1369016231:86 , srv1439631828:86 , srv1474999691:86 , srv1842116177:86 , srv1850034324:86 , srv1876017828:86 , srv1885731540:86 , srv2117907644:86 , srv219898665:86 , srv292193157:86 , srv478655885:86 , srv787107637:86 , srv917165220:86 , srv1045015180:87 , srv1182899518:87 , srv1315989177:87 , srv1324294386:87 , srv1348432602:87 , srv1547874343:87 , srv158496897:87 , srv167935963:87 , srv1792596248:87 , srv1868120455:87 , srv2146151222:87 , srv276071565:87 , srv284483831:87 , srv412290988:87 , srv515764198:87 , srv709464743:87 , srv751179767:87 , srv1459705741:88 , srv1470983896:88 , srv1701246523:88 , srv2143993783:88 , srv274301784:88 , srv791510777:88 , srv1043002951:89 , srv1595501161:89 , srv160032734:89 , srv1606773059:89 , srv1915331306:89 , srv220429606:89 , srv342416073:89 , srv585913571:89 , srv648622440:89 , srv941143952:89 , srv392851620:90 , srv49987789:90 , srv1001623692:91 , srv1030418689:91 , srv1166938823:91 , srv1280127442:91 , srv1857661559:91 , srv906395882:91 , srv926390624:91 , srv108936306:92 , srv2030652539:92 , srv1321189450:93 , srv231458794:93 , srv941706269:93 , srv1880640485:98 , srv1724355262:418 }
2023-03-16 04:53:58,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-16 04:53:58,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1470983896=27, srv1885731540=53, srv1256557521=14, srv1182899518=10, srv219898665=62, srv118843441=11, srv1088961078=6, srv1244635436=13, srv1017731432=1, srv412290988=75, srv1234261136=12, srv478655885=76, srv1321189450=20, srv941143952=98, srv1408097169=24, srv926390624=97, srv858299044=91, srv1606773059=35, srv1547874343=30, srv1459705741=26, srv276415232=68, srv1119188562=8, srv160032734=34, srv167935963=40, srv906395882=93, srv2117907644=58, srv1546430311=29, srv1043002951=3, srv1850034324=47, srv1624626229=36, srv787107637=87, srv1309562740=18, srv1045015180=4, srv871265559=92, srv49987789=78, srv547616622=81, srv199667904=55, srv709464743=85, srv791510777=88, srv1868120455=50, srv691770818=84, srv1309098623=17, srv1315989177=19, srv1661140118=38, srv1876017828=51, srv349649032=73, srv158496897=31, srv33065458=71, srv342416073=72, srv1474999691=28, srv274301784=66, srv1724355262=42, srv1792596248=44, srv911834638=94, srv1820728867=45, srv2146151222=61, srv1001623692=0, srv2030652539=56, srv2049470212=57, srv585913571=82, srv1287708701=16, srv941706269=99, srv1701246523=41, srv648622440=83, srv1668967590=39, srv220429606=63, srv515764198=80, srv918940416=96, srv1439631828=25, srv17549821=43, srv1166938823=9, srv1030418689=2, srv1857661559=49, srv1280127442=15, srv1324294386=21, srv828121330=89, srv162521149=37, srv1842116177=46, srv292193157=70, srv1915331306=54, srv284483831=69, srv392851620=74, srv2143993783=60, srv2137562587=59, srv1589883948=32, srv486441100=77, srv231458794=64, srv751179767=86, srv1851856173=48, srv108936306=7, srv1072157415=5, srv1348432602=22, srv276071565=67, srv851680923=90, srv510921125=79, srv917165220=95, srv252386941=65, srv1595501161=33, srv1880640485=52, srv1369016231=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-16 04:53:58,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-16 04:53:58,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-16 04:53:58,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-16 04:53:58,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-16 04:53:58,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-16 04:53:58,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-16 04:53:58,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-16 04:53:58,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-16 04:53:58,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-16 04:53:58,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-16 04:53:58,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-16 04:53:58,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-16 04:53:58,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-16 04:53:58,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-16 04:53:58,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-16 04:53:58,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-16 04:53:58,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-16 04:53:58,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-16 04:53:58,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-16 04:53:58,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-16 04:53:58,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-16 04:53:58,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-16 04:53:58,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-16 04:53:58,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-16 04:53:58,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-16 04:53:58,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-16 04:53:58,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-16 04:53:58,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-16 04:53:58,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-16 04:53:58,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-16 04:53:58,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-16 04:53:58,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-16 04:53:58,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-16 04:53:58,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-16 04:53:58,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-16 04:53:58,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-16 04:53:58,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-16 04:53:58,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-16 04:53:58,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-16 04:53:58,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-16 04:53:58,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-16 04:53:58,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-16 04:53:58,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-16 04:53:58,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-16 04:53:58,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-16 04:53:58,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-16 04:53:58,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-16 04:53:58,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-16 04:53:58,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-16 04:53:58,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-16 04:53:58,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-16 04:53:58,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-16 04:53:58,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-16 04:53:58,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-16 04:53:58,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-16 04:53:58,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-16 04:53:58,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-16 04:53:58,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-16 04:53:58,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-16 04:53:58,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-16 04:53:58,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-16 04:53:58,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-16 04:53:58,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-16 04:53:58,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-16 04:53:58,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-16 04:53:58,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-16 04:53:58,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-16 04:53:58,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-16 04:53:58,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-16 04:53:58,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-16 04:53:58,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-16 04:53:58,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-16 04:53:58,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-16 04:53:58,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-16 04:53:58,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-16 04:53:58,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-16 04:53:58,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-16 04:53:58,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-16 04:53:58,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-16 04:53:58,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-16 04:53:58,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-16 04:53:58,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-16 04:53:58,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-16 04:53:58,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-16 04:53:58,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-16 04:53:58,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-16 04:53:58,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-16 04:53:58,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-16 04:53:58,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-16 04:53:58,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-16 04:53:58,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-16 04:53:58,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-16 04:53:58,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-16 04:53:58,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-16 04:53:58,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-16 04:53:58,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-16 04:53:58,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-16 04:53:58,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-16 04:53:58,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-16 04:53:58,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-16 04:53:58,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-16 04:53:59,038 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036961539212676135, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056369790764971305, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.036961539212676135, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17591666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23991666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:53:59,038 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-16 04:53:59,038 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18040451805679486, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036961539212676135, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056369790764971305, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.036961539212676135, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17591666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23991666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-16 04:53:59,331 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 440 ms to try 5000 different iterations.  Found a solution that moves 2597 regions; Going from a computed imbalance of 0.18040451805679486 to a new imbalance of 0.014442277017027171. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023163025522167136); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039585393354157374, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28855555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023163025522167136); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043666666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:53:59,342 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1880640485:75 , srv941706269:77 , srv231458794:78 , srv1166938823:79 , srv1321189450:79 , srv2030652539:79 , srv1001623692:80 , srv1030418689:80 , srv1857661559:80 , srv906395882:80 , srv108936306:81 , srv926390624:81 , srv1043002951:82 , srv1606773059:82 , srv1915331306:82 , srv1280127442:83 , srv1595501161:83 , srv160032734:83 , srv2146151222:83 , srv274301784:83 , srv412290988:83 , srv648622440:83 , srv1045015180:84 , srv1315989177:84 , srv1324294386:84 , srv1348432602:84 , srv1868120455:84 , srv2143993783:84 , srv220429606:84 , srv276071565:84 , srv478655885:84 , srv515764198:84 , srv585913571:84 , srv791510777:84 , srv941143952:84 , srv1256557521:85 , srv1459705741:85 , srv1701246523:85 , srv1792596248:85 , srv1885731540:85 , srv33065458:85 , srv342416073:85 , srv349649032:85 , srv392851620:85 , srv49987789:85 , srv709464743:85 , srv751179767:85 , srv917165220:85 , srv1182899518:86 , srv1234261136:86 , srv1244635436:86 , srv1287708701:86 , srv1309562740:86 , srv1439631828:86 , srv1470983896:86 , srv1546430311:86 , srv1547874343:86 , srv158496897:86 , srv1624626229:86 , srv162521149:86 , srv17549821:86 , srv1842116177:86 , srv1850034324:86 , srv2117907644:86 , srv547616622:86 , srv787107637:86 , srv918940416:86 , srv1088961078:87 , srv1309098623:87 , srv167935963:87 , srv1820728867:87 , srv1876017828:87 , srv284483831:87 , srv828121330:87 , srv1369016231:88 , srv1474999691:88 , srv1661140118:88 , srv1851856173:88 , srv2137562587:88 , srv219898665:88 , srv292193157:88 , srv510921125:88 , srv691770818:88 , srv851680923:88 , srv871265559:88 , srv1017731432:89 , srv1072157415:89 , srv118843441:89 , srv1408097169:89 , srv1668967590:89 , srv199667904:89 , srv252386941:89 , srv911834638:89 , srv1119188562:90 , srv2049470212:90 , srv276415232:90 , srv486441100:90 , srv858299044:90 , srv1589883948:92 , srv1724355262:562 }
2023-03-16 04:53:59,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-16 04:53:59,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1470983896=27, srv1885731540=53, srv1256557521=14, srv1182899518=10, srv219898665=62, srv118843441=11, srv1088961078=6, srv1244635436=13, srv1017731432=1, srv412290988=75, srv1234261136=12, srv478655885=76, srv1321189450=20, srv941143952=98, srv1408097169=24, srv926390624=97, srv858299044=91, srv1606773059=35, srv1547874343=30, srv1459705741=26, srv276415232=68, srv1119188562=8, srv160032734=34, srv167935963=40, srv906395882=93, srv2117907644=58, srv1546430311=29, srv1043002951=3, srv1850034324=47, srv1624626229=36, srv787107637=87, srv1309562740=18, srv1045015180=4, srv871265559=92, srv49987789=78, srv547616622=81, srv199667904=55, srv709464743=85, srv791510777=88, srv1868120455=50, srv691770818=84, srv1309098623=17, srv1315989177=19, srv1661140118=38, srv1876017828=51, srv349649032=73, srv158496897=31, srv33065458=71, srv342416073=72, srv1474999691=28, srv274301784=66, srv1724355262=42, srv1792596248=44, srv911834638=94, srv1820728867=45, srv2146151222=61, srv1001623692=0, srv2030652539=56, srv2049470212=57, srv585913571=82, srv1287708701=16, srv941706269=99, srv1701246523=41, srv648622440=83, srv1668967590=39, srv220429606=63, srv515764198=80, srv918940416=96, srv1439631828=25, srv17549821=43, srv1166938823=9, srv1030418689=2, srv1857661559=49, srv1280127442=15, srv1324294386=21, srv828121330=89, srv162521149=37, srv1842116177=46, srv292193157=70, srv1915331306=54, srv284483831=69, srv392851620=74, srv2143993783=60, srv2137562587=59, srv1589883948=32, srv486441100=77, srv231458794=64, srv751179767=86, srv1851856173=48, srv108936306=7, srv1072157415=5, srv1348432602=22, srv276071565=67, srv851680923=90, srv510921125=79, srv917165220=95, srv252386941=65, srv1595501161=33, srv1880640485=52, srv1369016231=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-16 04:53:59,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-16 04:53:59,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-16 04:53:59,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-16 04:53:59,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-16 04:53:59,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-16 04:53:59,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-16 04:53:59,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-16 04:53:59,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-16 04:53:59,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-16 04:53:59,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-16 04:53:59,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-16 04:53:59,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-16 04:53:59,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-16 04:53:59,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-16 04:53:59,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-16 04:53:59,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-16 04:53:59,543 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023163025522167136); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039585393354157374, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023163025522167136); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043666666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:53:59,543 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-16 04:53:59,544 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014424092434360294, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023163025522167136); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039585393354157374, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023163025522167136); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043666666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-16 04:53:59,829 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 430 ms to try 5000 different iterations.  Found a solution that moves 933 regions; Going from a computed imbalance of 0.014424092434360294 to a new imbalance of 7.039644240604052E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009247804362219472); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0150420286618071); MoveCostFunction : (multiplier=7.0, imbalance=0.10366666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009247804362219472); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:53:59,831 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv49987789:81 , srv219898665:82 , srv1119188562:83 , srv1280127442:83 , srv1369016231:83 , srv1459705741:83 , srv1470983896:83 , srv1474999691:83 , srv199667904:83 , srv392851620:83 , srv858299044:83 , srv1088961078:84 , srv1182899518:84 , srv1408097169:84 , srv1547874343:84 , srv158496897:84 , srv1668967590:84 , srv167935963:84 , srv1701246523:84 , srv1792596248:84 , srv1850034324:84 , srv1880640485:84 , srv2049470212:84 , srv252386941:84 , srv284483831:84 , srv292193157:84 , srv342416073:84 , srv585913571:84 , srv941143952:84 , srv1017731432:85 , srv1072157415:85 , srv108936306:85 , srv1234261136:85 , srv1309098623:85 , srv1309562740:85 , srv1315989177:85 , srv1321189450:85 , srv1324294386:85 , srv1439631828:85 , srv1546430311:85 , srv1595501161:85 , srv1661140118:85 , srv1820728867:85 , srv1842116177:85 , srv1876017828:85 , srv2030652539:85 , srv2137562587:85 , srv220429606:85 , srv486441100:85 , srv648622440:85 , srv691770818:85 , srv709464743:85 , srv787107637:85 , srv828121330:85 , srv911834638:85 , srv926390624:85 , srv1043002951:86 , srv1045015180:86 , srv1166938823:86 , srv118843441:86 , srv1244635436:86 , srv1256557521:86 , srv1287708701:86 , srv1348432602:86 , srv160032734:86 , srv1606773059:86 , srv1857661559:86 , srv1885731540:86 , srv2117907644:86 , srv231458794:86 , srv274301784:86 , srv276071565:86 , srv276415232:86 , srv412290988:86 , srv510921125:86 , srv791510777:86 , srv871265559:86 , srv917165220:86 , srv918940416:86 , srv1001623692:87 , srv1030418689:87 , srv1589883948:87 , srv162521149:87 , srv1851856173:87 , srv1868120455:87 , srv1915331306:87 , srv2143993783:87 , srv2146151222:87 , srv349649032:87 , srv515764198:87 , srv547616622:87 , srv751179767:87 , srv851680923:87 , srv906395882:87 , srv941706269:87 , srv1624626229:88 , srv17549821:88 , srv33065458:88 , srv478655885:89 , srv1724355262:560 }
2023-03-16 04:53:59,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-16 04:53:59,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1470983896=27, srv1885731540=53, srv1256557521=14, srv1182899518=10, srv219898665=62, srv118843441=11, srv1088961078=6, srv1244635436=13, srv1017731432=1, srv412290988=75, srv1234261136=12, srv478655885=76, srv1321189450=20, srv941143952=98, srv1408097169=24, srv926390624=97, srv858299044=91, srv1606773059=35, srv1547874343=30, srv1459705741=26, srv276415232=68, srv1119188562=8, srv160032734=34, srv167935963=40, srv906395882=93, srv2117907644=58, srv1546430311=29, srv1043002951=3, srv1850034324=47, srv1624626229=36, srv787107637=87, srv1309562740=18, srv1045015180=4, srv871265559=92, srv49987789=78, srv547616622=81, srv199667904=55, srv709464743=85, srv791510777=88, srv1868120455=50, srv691770818=84, srv1309098623=17, srv1315989177=19, srv1661140118=38, srv1876017828=51, srv349649032=73, srv158496897=31, srv33065458=71, srv342416073=72, srv1474999691=28, srv274301784=66, srv1724355262=42, srv1792596248=44, srv911834638=94, srv1820728867=45, srv2146151222=61, srv1001623692=0, srv2030652539=56, srv2049470212=57, srv585913571=82, srv1287708701=16, srv941706269=99, srv1701246523=41, srv648622440=83, srv1668967590=39, srv220429606=63, srv515764198=80, srv918940416=96, srv1439631828=25, srv17549821=43, srv1166938823=9, srv1030418689=2, srv1857661559=49, srv1280127442=15, srv1324294386=21, srv828121330=89, srv162521149=37, srv1842116177=46, srv292193157=70, srv1915331306=54, srv284483831=69, srv392851620=74, srv2143993783=60, srv2137562587=59, srv1589883948=32, srv486441100=77, srv231458794=64, srv751179767=86, srv1851856173=48, srv108936306=7, srv1072157415=5, srv1348432602=22, srv276071565=67, srv851680923=90, srv510921125=79, srv917165220=95, srv252386941=65, srv1595501161=33, srv1880640485=52, srv1369016231=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-16 04:53:59,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-16 04:53:59,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-16 04:53:59,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-16 04:53:59,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-16 04:53:59,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-16 04:53:59,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-16 04:53:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-16 04:53:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-16 04:53:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-16 04:53:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-16 04:53:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-16 04:53:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-16 04:53:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-16 04:53:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-16 04:53:59,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-16 04:53:59,959 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009247804362219472); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0150420286618071); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009247804362219472); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:53:59,959 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-16 04:53:59,959 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.97431418427676E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009247804362219472); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0150420286618071); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009247804362219472); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-16 04:54:00,320 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 456 ms to try 5000 different iterations.  Found a solution that moves 312 regions; Going from a computed imbalance of 6.97431418427676E-4 to a new imbalance of 4.620140796421802E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002551379987942442); MoveCostFunction : (multiplier=7.0, imbalance=0.034666666666666665, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:54:00,322 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv17549821:83 , srv1851856173:83 , srv2143993783:83 , srv478655885:83 , srv751179767:83 , srv911834638:83 , srv1001623692:84 , srv1030418689:84 , srv1072157415:84 , srv108936306:84 , srv1287708701:84 , srv1348432602:84 , srv1589883948:84 , srv160032734:84 , srv1624626229:84 , srv1668967590:84 , srv167935963:84 , srv1868120455:84 , srv1876017828:84 , srv1915331306:84 , srv2049470212:84 , srv2117907644:84 , srv220429606:84 , srv284483831:84 , srv292193157:84 , srv33065458:84 , srv342416073:84 , srv486441100:84 , srv510921125:84 , srv515764198:84 , srv547616622:84 , srv791510777:84 , srv851680923:84 , srv871265559:84 , srv906395882:84 , srv941706269:84 , srv1017731432:85 , srv1045015180:85 , srv1182899518:85 , srv118843441:85 , srv1256557521:85 , srv1280127442:85 , srv1309098623:85 , srv1321189450:85 , srv1439631828:85 , srv1470983896:85 , srv1474999691:85 , srv158496897:85 , srv1595501161:85 , srv162521149:85 , srv1661140118:85 , srv1701246523:85 , srv1842116177:85 , srv1857661559:85 , srv1880640485:85 , srv1885731540:85 , srv199667904:85 , srv2137562587:85 , srv2146151222:85 , srv219898665:85 , srv231458794:85 , srv274301784:85 , srv276071565:85 , srv276415232:85 , srv349649032:85 , srv392851620:85 , srv49987789:85 , srv585913571:85 , srv648622440:85 , srv691770818:85 , srv709464743:85 , srv917165220:85 , srv918940416:85 , srv926390624:85 , srv1043002951:86 , srv1088961078:86 , srv1119188562:86 , srv1166938823:86 , srv1234261136:86 , srv1244635436:86 , srv1309562740:86 , srv1315989177:86 , srv1324294386:86 , srv1369016231:86 , srv1408097169:86 , srv1459705741:86 , srv1546430311:86 , srv1547874343:86 , srv1606773059:86 , srv1792596248:86 , srv1820728867:86 , srv1850034324:86 , srv2030652539:86 , srv252386941:86 , srv412290988:86 , srv787107637:86 , srv828121330:86 , srv858299044:86 , srv941143952:86 , srv1724355262:602 }
2023-03-16 04:54:00,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-16 04:54:00,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1470983896=27, srv1885731540=53, srv1256557521=14, srv1182899518=10, srv219898665=62, srv118843441=11, srv1088961078=6, srv1244635436=13, srv1017731432=1, srv412290988=75, srv1234261136=12, srv478655885=76, srv1321189450=20, srv941143952=98, srv1408097169=24, srv926390624=97, srv858299044=91, srv1606773059=35, srv1547874343=30, srv1459705741=26, srv276415232=68, srv1119188562=8, srv160032734=34, srv167935963=40, srv906395882=93, srv2117907644=58, srv1546430311=29, srv1043002951=3, srv1850034324=47, srv1624626229=36, srv787107637=87, srv1309562740=18, srv1045015180=4, srv871265559=92, srv49987789=78, srv547616622=81, srv199667904=55, srv709464743=85, srv791510777=88, srv1868120455=50, srv691770818=84, srv1309098623=17, srv1315989177=19, srv1661140118=38, srv1876017828=51, srv349649032=73, srv158496897=31, srv33065458=71, srv342416073=72, srv1474999691=28, srv274301784=66, srv1724355262=42, srv1792596248=44, srv911834638=94, srv1820728867=45, srv2146151222=61, srv1001623692=0, srv2030652539=56, srv2049470212=57, srv585913571=82, srv1287708701=16, srv941706269=99, srv1701246523=41, srv648622440=83, srv1668967590=39, srv220429606=63, srv515764198=80, srv918940416=96, srv1439631828=25, srv17549821=43, srv1166938823=9, srv1030418689=2, srv1857661559=49, srv1280127442=15, srv1324294386=21, srv828121330=89, srv162521149=37, srv1842116177=46, srv292193157=70, srv1915331306=54, srv284483831=69, srv392851620=74, srv2143993783=60, srv2137562587=59, srv1589883948=32, srv486441100=77, srv231458794=64, srv751179767=86, srv1851856173=48, srv108936306=7, srv1072157415=5, srv1348432602=22, srv276071565=67, srv851680923=90, srv510921125=79, srv917165220=95, srv252386941=65, srv1595501161=33, srv1880640485=52, srv1369016231=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-16 04:54:00,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-16 04:54:00,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-16 04:54:00,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-16 04:54:00,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-16 04:54:00,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-16 04:54:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-16 04:54:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-16 04:54:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-16 04:54:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-16 04:54:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-16 04:54:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-16 04:54:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-16 04:54:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-16 04:54:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-16 04:54:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-16 04:54:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-16 04:54:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-16 04:54:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-16 04:54:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-16 04:54:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-16 04:54:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-16 04:54:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-16 04:54:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-16 04:54:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-16 04:54:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-16 04:54:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-16 04:54:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-16 04:54:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-16 04:54:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-16 04:54:00,455 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002551379987942442); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:54:00,455 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-16 04:54:00,456 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.401673727031499E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002551379987942442); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-16 04:54:00,759 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 406 ms to try 5000 different iterations.  Found a solution that moves 50 regions; Going from a computed imbalance of 4.401673727031499E-5 to a new imbalance of 7.73786498330984E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.005555555555555556); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:54:00,759 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1043002951:83 , srv1244635436:83 , srv1369016231:83 , srv1547874343:83 , srv1589883948:83 , srv1606773059:83 , srv392851620:83 , srv787107637:83 , srv828121330:83 , srv858299044:83 , srv941143952:83 , srv1001623692:84 , srv1017731432:84 , srv1030418689:84 , srv1045015180:84 , srv1072157415:84 , srv1088961078:84 , srv108936306:84 , srv1119188562:84 , srv1166938823:84 , srv1182899518:84 , srv1234261136:84 , srv1256557521:84 , srv1280127442:84 , srv1309098623:84 , srv1309562740:84 , srv1315989177:84 , srv1321189450:84 , srv1324294386:84 , srv1408097169:84 , srv1439631828:84 , srv1459705741:84 , srv1470983896:84 , srv1474999691:84 , srv1546430311:84 , srv158496897:84 , srv1595501161:84 , srv160032734:84 , srv1624626229:84 , srv162521149:84 , srv1661140118:84 , srv1668967590:84 , srv167935963:84 , srv1701246523:84 , srv17549821:84 , srv1792596248:84 , srv1820728867:84 , srv1842116177:84 , srv1850034324:84 , srv1857661559:84 , srv1868120455:84 , srv1876017828:84 , srv1880640485:84 , srv1885731540:84 , srv1915331306:84 , srv199667904:84 , srv2030652539:84 , srv2049470212:84 , srv2117907644:84 , srv2143993783:84 , srv2146151222:84 , srv220429606:84 , srv231458794:84 , srv252386941:84 , srv274301784:84 , srv276071565:84 , srv276415232:84 , srv284483831:84 , srv292193157:84 , srv33065458:84 , srv342416073:84 , srv349649032:84 , srv412290988:84 , srv478655885:84 , srv510921125:84 , srv515764198:84 , srv547616622:84 , srv585913571:84 , srv648622440:84 , srv691770818:84 , srv709464743:84 , srv751179767:84 , srv791510777:84 , srv851680923:84 , srv871265559:84 , srv906395882:84 , srv917165220:84 , srv926390624:84 , srv118843441:85 , srv1287708701:85 , srv1348432602:85 , srv1851856173:85 , srv2137562587:85 , srv219898665:85 , srv486441100:85 , srv49987789:85 , srv911834638:85 , srv918940416:85 , srv941706269:85 , srv1724355262:684 }
2023-03-16 04:54:00,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-16 04:54:00,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1470983896=27, srv1885731540=53, srv1256557521=14, srv1182899518=10, srv219898665=62, srv118843441=11, srv1088961078=6, srv1244635436=13, srv1017731432=1, srv412290988=75, srv1234261136=12, srv478655885=76, srv1321189450=20, srv941143952=98, srv1408097169=24, srv926390624=97, srv858299044=91, srv1606773059=35, srv1547874343=30, srv1459705741=26, srv276415232=68, srv1119188562=8, srv160032734=34, srv167935963=40, srv906395882=93, srv2117907644=58, srv1546430311=29, srv1043002951=3, srv1850034324=47, srv1624626229=36, srv787107637=87, srv1309562740=18, srv1045015180=4, srv871265559=92, srv49987789=78, srv547616622=81, srv199667904=55, srv709464743=85, srv791510777=88, srv1868120455=50, srv691770818=84, srv1309098623=17, srv1315989177=19, srv1661140118=38, srv1876017828=51, srv349649032=73, srv158496897=31, srv33065458=71, srv342416073=72, srv1474999691=28, srv274301784=66, srv1724355262=42, srv1792596248=44, srv911834638=94, srv1820728867=45, srv2146151222=61, srv1001623692=0, srv2030652539=56, srv2049470212=57, srv585913571=82, srv1287708701=16, srv941706269=99, srv1701246523=41, srv648622440=83, srv1668967590=39, srv220429606=63, srv515764198=80, srv918940416=96, srv1439631828=25, srv17549821=43, srv1166938823=9, srv1030418689=2, srv1857661559=49, srv1280127442=15, srv1324294386=21, srv828121330=89, srv162521149=37, srv1842116177=46, srv292193157=70, srv1915331306=54, srv284483831=69, srv392851620=74, srv2143993783=60, srv2137562587=59, srv1589883948=32, srv486441100=77, srv231458794=64, srv751179767=86, srv1851856173=48, srv108936306=7, srv1072157415=5, srv1348432602=22, srv276071565=67, srv851680923=90, srv510921125=79, srv917165220=95, srv252386941=65, srv1595501161=33, srv1880640485=52, srv1369016231=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-16 04:54:00,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-16 04:54:00,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-16 04:54:00,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-16 04:54:00,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-16 04:54:00,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-16 04:54:00,889 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:54:00,889 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1043002951:83 , srv1244635436:83 , srv1369016231:83 , srv1547874343:83 , srv1589883948:83 , srv1606773059:83 , srv392851620:83 , srv787107637:83 , srv828121330:83 , srv858299044:83 , srv941143952:83 , srv1001623692:84 , srv1017731432:84 , srv1030418689:84 , srv1045015180:84 , srv1072157415:84 , srv1088961078:84 , srv108936306:84 , srv1119188562:84 , srv1166938823:84 , srv1182899518:84 , srv1234261136:84 , srv1256557521:84 , srv1280127442:84 , srv1309098623:84 , srv1309562740:84 , srv1315989177:84 , srv1321189450:84 , srv1324294386:84 , srv1408097169:84 , srv1439631828:84 , srv1459705741:84 , srv1470983896:84 , srv1474999691:84 , srv1546430311:84 , srv158496897:84 , srv1595501161:84 , srv160032734:84 , srv1624626229:84 , srv162521149:84 , srv1661140118:84 , srv1668967590:84 , srv167935963:84 , srv1701246523:84 , srv17549821:84 , srv1792596248:84 , srv1820728867:84 , srv1842116177:84 , srv1850034324:84 , srv1857661559:84 , srv1868120455:84 , srv1876017828:84 , srv1880640485:84 , srv1885731540:84 , srv1915331306:84 , srv199667904:84 , srv2030652539:84 , srv2049470212:84 , srv2117907644:84 , srv2143993783:84 , srv2146151222:84 , srv220429606:84 , srv231458794:84 , srv252386941:84 , srv274301784:84 , srv276071565:84 , srv276415232:84 , srv284483831:84 , srv292193157:84 , srv33065458:84 , srv342416073:84 , srv349649032:84 , srv412290988:84 , srv478655885:84 , srv510921125:84 , srv515764198:84 , srv547616622:84 , srv585913571:84 , srv648622440:84 , srv691770818:84 , srv709464743:84 , srv751179767:84 , srv791510777:84 , srv851680923:84 , srv871265559:84 , srv906395882:84 , srv917165220:84 , srv926390624:84 , srv118843441:85 , srv1287708701:85 , srv1348432602:85 , srv1851856173:85 , srv2137562587:85 , srv219898665:85 , srv486441100:85 , srv49987789:85 , srv911834638:85 , srv918940416:85 , srv941706269:85 , srv1724355262:684 }
2023-03-16 04:54:00,914 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=415 (was 408) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=6370 (was 6896)
2023-03-16 04:54:00,921 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=415, ProcessCount=169, AvailableMemoryMB=6370
2023-03-16 04:54:00,922 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-16 04:54:00,922 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-16 04:54:00,932 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1027683197:84 , srv1061096288:84 , srv1120292317:84 , srv1158512510:84 , srv122598575:84 , srv1385617005:84 , srv1386834854:84 , srv1411180544:84 , srv1499407991:84 , srv1571611882:84 , srv1644316881:84 , srv1690149845:84 , srv185435847:84 , srv1896911624:84 , srv1900891466:84 , srv1910943790:84 , srv2091931334:84 , srv300574543:84 , srv306390369:84 , srv457240455:84 , srv492296241:84 , srv534800175:84 , srv612280875:84 , srv658629378:84 , srv727864213:84 , srv770762235:84 , srv822387633:84 , srv992918978:84 , srv996224359:84 , srv1467738668:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-16 04:54:00,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-16 04:54:00,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1644316881=11, srv534800175=22, srv727864213=25, srv1158512510=3, srv1499407991=9, srv2091931334=17, srv1027683197=0, srv1896911624=14, srv612280875=23, srv992918978=28, srv658629378=24, srv770762235=26, srv1900891466=15, srv822387633=27, srv185435847=13, srv1385617005=5, srv122598575=4, srv306390369=19, srv457240455=20, srv1467738668=8, srv300574543=18, srv1061096288=1, srv1411180544=7, srv1571611882=10, srv1386834854=6, srv1690149845=12, srv492296241=21, srv996224359=29, srv1120292317=2, srv1910943790=16} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-16 04:54:00,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-16 04:54:00,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-16 04:54:00,962 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1608742316560503, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:54:00,962 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.99126999527152, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1608742316560503, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-16 04:56:00,949 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5806002 different iterations.  Found a solution that moves 1852 regions; Going from a computed imbalance of 0.99126999527152 to a new imbalance of 4.322660390073086E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6859259259259259, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:56:00,955 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1027683197:90 , srv1061096288:90 , srv1120292317:90 , srv1158512510:90 , srv122598575:90 , srv1385617005:90 , srv1386834854:90 , srv1411180544:90 , srv1467738668:90 , srv1499407991:90 , srv1571611882:90 , srv1644316881:90 , srv1690149845:90 , srv185435847:90 , srv1896911624:90 , srv1900891466:90 , srv1910943790:90 , srv2091931334:90 , srv300574543:90 , srv306390369:90 , srv457240455:90 , srv492296241:90 , srv534800175:90 , srv612280875:90 , srv658629378:90 , srv727864213:90 , srv770762235:90 , srv822387633:90 , srv992918978:90 , srv996224359:90 }
2023-03-16 04:56:00,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-16 04:56:00,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1644316881=11, srv534800175=22, srv727864213=25, srv1158512510=3, srv1499407991=9, srv2091931334=17, srv1027683197=0, srv1896911624=14, srv612280875=23, srv992918978=28, srv658629378=24, srv770762235=26, srv1900891466=15, srv822387633=27, srv185435847=13, srv1385617005=5, srv122598575=4, srv306390369=19, srv457240455=20, srv1467738668=8, srv300574543=18, srv1061096288=1, srv1411180544=7, srv1571611882=10, srv1386834854=6, srv1690149845=12, srv492296241=21, srv996224359=29, srv1120292317=2, srv1910943790=16} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-16 04:56:00,959 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-16 04:56:00,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-16 04:56:00,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-16 04:56:00,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-16 04:56:00,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-16 04:56:00,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-16 04:56:00,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-16 04:56:00,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-16 04:56:00,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-16 04:56:00,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-16 04:56:00,972 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-16 04:56:00,973 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1027683197:90 , srv1061096288:90 , srv1120292317:90 , srv1158512510:90 , srv122598575:90 , srv1385617005:90 , srv1386834854:90 , srv1411180544:90 , srv1467738668:90 , srv1499407991:90 , srv1571611882:90 , srv1644316881:90 , srv1690149845:90 , srv185435847:90 , srv1896911624:90 , srv1900891466:90 , srv1910943790:90 , srv2091931334:90 , srv300574543:90 , srv306390369:90 , srv457240455:90 , srv492296241:90 , srv534800175:90 , srv612280875:90 , srv658629378:90 , srv727864213:90 , srv770762235:90 , srv822387633:90 , srv992918978:90 , srv996224359:90 }
2023-03-16 04:56:00,984 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=145 (was 415), ProcessCount=169 (was 169), AvailableMemoryMB=6014 (was 6370)