2023-04-17 10:53:34,763 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-17 10:53:35,051 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-17 10:53:35,158 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-17 10:53:35,213 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-17 10:53:35,219 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-17 10:53:35,230 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=463, ProcessCount=170, AvailableMemoryMB=8998
2023-04-17 10:53:35,231 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-17 10:53:35,231 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-17 10:53:35,352 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv103536864:84 , srv1036489055:84 , srv1058765473:84 , srv1077296838:84 , srv1094584594:84 , srv1103948034:84 , srv1151668370:84 , srv1155085411:84 , srv1215818124:84 , srv1230091316:84 , srv1272736673:84 , srv1290495343:84 , srv1296772496:84 , srv1337513128:84 , srv1376342077:84 , srv1382840554:84 , srv1385243665:84 , srv1419700475:84 , srv151294591:84 , srv1520496715:84 , srv1522318948:84 , srv1542792884:84 , srv1567329293:84 , srv1574521481:84 , srv159112989:84 , srv1593061065:84 , srv1643441811:84 , srv1646247741:84 , srv166764077:84 , srv168090709:84 , srv171435662:84 , srv1715092217:84 , srv1721909937:84 , srv1743147943:84 , srv1757334147:84 , srv1758844472:84 , srv1765249756:84 , srv1771043742:84 , srv1793837945:84 , srv1824051623:84 , srv1833628712:84 , srv184560774:84 , srv1856114229:84 , srv1867814178:84 , srv1911785235:84 , srv1913822245:84 , srv1914544052:84 , srv1924943841:84 , srv1927041700:84 , srv1927904734:84 , srv1934629086:84 , srv1984116909:84 , srv2021926878:84 , srv2031963137:84 , srv2033059877:84 , srv2040113115:84 , srv2097357319:84 , srv2124178801:84 , srv242066365:84 , srv263435141:84 , srv269477038:84 , srv319574754:84 , srv356589709:84 , srv368515174:84 , srv374048309:84 , srv382808340:84 , srv397742484:84 , srv400909509:84 , srv421363471:84 , srv455079721:84 , srv472972755:84 , srv476504011:84 , srv530896649:84 , srv54812660:84 , srv549499509:84 , srv552496213:84 , srv571548650:84 , srv582076514:84 , srv592045145:84 , srv599548595:84 , srv610719501:84 , srv616714649:84 , srv637213479:84 , srv715689846:84 , srv746752104:84 , srv773413968:84 , srv774900704:84 , srv775349811:84 , srv782845299:84 , srv789134534:84 , srv903351578:84 , srv913384193:84 , srv916485521:84 , srv928735166:84 , srv941163118:84 , srv944666911:84 , srv956171811:84 , srv962636466:84 , srv97178431:84 , srv1333596561:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-17 10:53:35,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 10:53:35,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv166764077=29, srv151294591=19, srv1296772496=12, srv1077296838=3, srv2124178801=58, srv400909509=68, srv956171811=97, srv1155085411=7, srv637213479=83, srv789134534=90, srv1215818124=8, srv610719501=81, srv571548650=77, srv356589709=63, srv592045145=79, srv171435662=31, srv97178431=99, srv1721909937=33, srv184560774=42, srv319574754=62, srv774900704=87, srv368515174=64, srv2097357319=57, srv599548595=80, srv1867814178=44, srv773413968=86, srv962636466=98, srv1567329293=23, srv472972755=71, srv397742484=67, srv1522318948=21, srv1934629086=51, srv1036489055=1, srv1333596561=13, srv1743147943=34, srv421363471=69, srv1927041700=49, srv1520496715=20, srv1094584594=4, srv54812660=74, srv1715092217=32, srv103536864=0, srv1385243665=17, srv1911785235=45, srv1927904734=50, srv1272736673=10, srv159112989=25, srv1376342077=15, srv1643441811=27, srv2021926878=53, srv1914544052=47, srv1646247741=28, srv1593061065=26, srv903351578=91, srv1542792884=22, srv455079721=70, srv1984116909=52, srv168090709=30, srv1856114229=43, srv374048309=65, srv916485521=93, srv549499509=75, srv715689846=84, srv582076514=78, srv2033059877=55, srv1913822245=46, srv941163118=95, srv1758844472=36, srv1151668370=6, srv1757334147=35, srv1230091316=9, srv1290495343=11, srv1765249756=37, srv1793837945=39, srv2040113115=56, srv1103948034=5, srv242066365=59, srv1824051623=40, srv616714649=82, srv1337513128=14, srv746752104=85, srv775349811=88, srv782845299=89, srv2031963137=54, srv269477038=61, srv552496213=76, srv913384193=92, srv263435141=60, srv382808340=66, srv1771043742=38, srv944666911=96, srv1419700475=18, srv928735166=94, srv476504011=72, srv1574521481=24, srv1833628712=41, srv1924943841=48, srv530896649=73, srv1382840554=16, srv1058765473=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 10:53:35,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 10:53:35,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 10:53:35,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 10:53:35,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 10:53:35,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 10:53:35,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 10:53:35,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 10:53:35,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 10:53:35,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 10:53:35,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 10:53:35,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 10:53:35,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 10:53:35,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 10:53:35,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 10:53:35,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 10:53:35,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 10:53:35,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 10:53:35,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 10:53:35,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 10:53:35,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 10:53:35,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 10:53:35,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 10:53:35,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 10:53:35,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 10:53:35,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 10:53:35,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 10:53:35,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 10:53:35,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 10:53:35,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 10:53:35,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 10:53:35,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-17 10:53:35,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-17 10:53:35,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-17 10:53:35,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-17 10:53:35,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-17 10:53:35,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-17 10:53:35,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-17 10:53:35,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-17 10:53:35,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-17 10:53:35,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-17 10:53:35,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-17 10:53:35,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-17 10:53:35,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-17 10:53:35,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-17 10:53:35,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-17 10:53:35,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-17 10:53:35,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-17 10:53:35,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-17 10:53:35,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-17 10:53:35,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-17 10:53:35,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-17 10:53:35,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-17 10:53:35,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-17 10:53:35,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-17 10:53:35,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-17 10:53:35,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-17 10:53:35,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-17 10:53:35,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-17 10:53:35,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-17 10:53:35,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-17 10:53:35,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-17 10:53:35,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-17 10:53:35,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-17 10:53:35,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-17 10:53:35,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-17 10:53:35,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-17 10:53:35,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-17 10:53:35,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-17 10:53:35,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-17 10:53:35,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-17 10:53:35,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-17 10:53:35,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-17 10:53:35,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-17 10:53:35,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-17 10:53:35,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-17 10:53:35,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-17 10:53:35,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-17 10:53:35,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-17 10:53:35,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-17 10:53:35,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-17 10:53:35,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-17 10:53:35,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-17 10:53:35,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-17 10:53:35,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-17 10:53:35,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-17 10:53:35,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-17 10:53:35,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-17 10:53:35,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-17 10:53:35,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-17 10:53:35,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-17 10:53:35,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-17 10:53:35,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-17 10:53:35,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-17 10:53:35,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-17 10:53:35,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-17 10:53:35,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-17 10:53:35,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-17 10:53:35,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-17 10:53:35,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-17 10:53:35,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-17 10:53:35,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-17 10:53:35,590 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:53:35,590 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-17 10:53:35,591 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-17 10:53:35,830 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 360 ms to try 5000 different iterations.  Found a solution that moves 4711 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1785425963013286. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042619373808380046, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06268765319482933, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5234444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042619373808380046, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:53:35,840 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv151294591:82 , srv1567329293:83 , srv1646247741:83 , srv1771043742:83 , srv1793837945:83 , srv1924943841:83 , srv1934629086:83 , srv374048309:83 , srv397742484:83 , srv472972755:83 , srv775349811:83 , srv941163118:83 , srv103536864:84 , srv1542792884:84 , srv171435662:84 , srv1715092217:84 , srv1743147943:84 , srv184560774:84 , srv1927041700:84 , srv2124178801:84 , srv356589709:84 , srv368515174:84 , srv476504011:84 , srv552496213:84 , srv715689846:84 , srv746752104:84 , srv913384193:84 , srv1058765473:85 , srv1272736673:85 , srv1520496715:85 , srv1593061065:85 , srv1758844472:85 , srv1914544052:85 , srv2031963137:85 , srv242066365:85 , srv269477038:85 , srv382808340:85 , srv400909509:85 , srv455079721:85 , srv773413968:85 , srv774900704:85 , srv916485521:85 , srv962636466:85 , srv97178431:85 , srv1036489055:86 , srv1094584594:86 , srv1151668370:86 , srv1230091316:86 , srv1290495343:86 , srv1382840554:86 , srv159112989:86 , srv1721909937:86 , srv1833628712:86 , srv1927904734:86 , srv1984116909:86 , srv2097357319:86 , srv582076514:86 , srv1385243665:87 , srv1522318948:87 , srv1574521481:87 , srv1643441811:87 , srv168090709:87 , srv1757334147:87 , srv1824051623:87 , srv1856114229:87 , srv1867814178:87 , srv1911785235:87 , srv2021926878:87 , srv263435141:87 , srv319574754:87 , srv599548595:87 , srv789134534:87 , srv903351578:87 , srv944666911:87 , srv1077296838:88 , srv1215818124:88 , srv1337513128:88 , srv1419700475:88 , srv166764077:88 , srv1765249756:88 , srv54812660:88 , srv592045145:88 , srv610719501:88 , srv928735166:88 , srv956171811:88 , srv1155085411:89 , srv1376342077:89 , srv549499509:89 , srv616714649:89 , srv782845299:89 , srv1103948034:90 , srv2033059877:90 , srv2040113115:90 , srv530896649:90 , srv637213479:90 , srv571548650:91 , srv421363471:92 , srv1913822245:93 , srv1296772496:95 , srv1333596561:469 }
2023-04-17 10:53:35,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 10:53:35,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv166764077=29, srv151294591=19, srv1296772496=12, srv1077296838=3, srv2124178801=58, srv400909509=68, srv956171811=97, srv1155085411=7, srv637213479=83, srv789134534=90, srv1215818124=8, srv610719501=81, srv571548650=77, srv356589709=63, srv592045145=79, srv171435662=31, srv97178431=99, srv1721909937=33, srv184560774=42, srv319574754=62, srv774900704=87, srv368515174=64, srv2097357319=57, srv599548595=80, srv1867814178=44, srv773413968=86, srv962636466=98, srv1567329293=23, srv472972755=71, srv397742484=67, srv1522318948=21, srv1934629086=51, srv1036489055=1, srv1333596561=13, srv1743147943=34, srv421363471=69, srv1927041700=49, srv1520496715=20, srv1094584594=4, srv54812660=74, srv1715092217=32, srv103536864=0, srv1385243665=17, srv1911785235=45, srv1927904734=50, srv1272736673=10, srv159112989=25, srv1376342077=15, srv1643441811=27, srv2021926878=53, srv1914544052=47, srv1646247741=28, srv1593061065=26, srv903351578=91, srv1542792884=22, srv455079721=70, srv1984116909=52, srv168090709=30, srv1856114229=43, srv374048309=65, srv916485521=93, srv549499509=75, srv715689846=84, srv582076514=78, srv2033059877=55, srv1913822245=46, srv941163118=95, srv1758844472=36, srv1151668370=6, srv1757334147=35, srv1230091316=9, srv1290495343=11, srv1765249756=37, srv1793837945=39, srv2040113115=56, srv1103948034=5, srv242066365=59, srv1824051623=40, srv616714649=82, srv1337513128=14, srv746752104=85, srv775349811=88, srv782845299=89, srv2031963137=54, srv269477038=61, srv552496213=76, srv913384193=92, srv263435141=60, srv382808340=66, srv1771043742=38, srv944666911=96, srv1419700475=18, srv928735166=94, srv476504011=72, srv1574521481=24, srv1833628712=41, srv1924943841=48, srv530896649=73, srv1382840554=16, srv1058765473=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 10:53:35,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 10:53:35,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 10:53:35,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 10:53:35,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 10:53:35,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-17 10:53:35,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-17 10:53:35,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-17 10:53:35,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-17 10:53:35,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-17 10:53:35,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-17 10:53:35,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-17 10:53:35,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-17 10:53:35,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-17 10:53:35,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-17 10:53:35,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-17 10:53:35,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-17 10:53:35,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-17 10:53:35,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-17 10:53:35,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-17 10:53:35,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-17 10:53:35,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-17 10:53:35,965 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042619373808380046, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06268765319482933, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042619373808380046, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:53:35,965 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-17 10:53:35,965 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1785096091742806, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042619373808380046, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06268765319482933, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042619373808380046, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-17 10:53:36,149 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 262 ms to try 5000 different iterations.  Found a solution that moves 2642 regions; Going from a computed imbalance of 0.1785096091742806 to a new imbalance of 0.014925549237046531. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023975191900414028); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036007232095614204, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29355555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023975191900414028); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04416666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:53:36,156 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1296772496:75 , srv1913822245:78 , srv1103948034:80 , srv421363471:80 , srv1155085411:81 , srv530896649:81 , srv54812660:81 , srv549499509:81 , srv1215818124:82 , srv168090709:82 , srv1911785235:82 , srv571548650:82 , srv1867814178:83 , srv592045145:83 , srv599548595:83 , srv616714649:83 , srv956171811:83 , srv1036489055:84 , srv1077296838:84 , srv1593061065:84 , srv1765249756:84 , srv1856114229:84 , srv1984116909:84 , srv2021926878:84 , srv319574754:84 , srv789134534:84 , srv903351578:84 , srv103536864:85 , srv1094584594:85 , srv1230091316:85 , srv1272736673:85 , srv1376342077:85 , srv1385243665:85 , srv1419700475:85 , srv1643441811:85 , srv166764077:85 , srv1721909937:85 , srv1757334147:85 , srv1758844472:85 , srv1824051623:85 , srv2033059877:85 , srv2040113115:85 , srv2097357319:85 , srv242066365:85 , srv610719501:85 , srv782845299:85 , srv928735166:85 , srv1058765473:86 , srv1337513128:86 , srv1520496715:86 , srv1743147943:86 , srv1833628712:86 , srv184560774:86 , srv269477038:86 , srv476504011:86 , srv582076514:86 , srv637213479:86 , srv775349811:86 , srv916485521:86 , srv944666911:86 , srv1151668370:87 , srv1522318948:87 , srv1542792884:87 , srv1574521481:87 , srv159112989:87 , srv171435662:87 , srv1771043742:87 , srv1914544052:87 , srv2031963137:87 , srv263435141:87 , srv382808340:87 , srv455079721:87 , srv97178431:87 , srv1290495343:88 , srv1793837945:88 , srv1924943841:88 , srv368515174:88 , srv552496213:88 , srv715689846:88 , srv746752104:88 , srv773413968:88 , srv774900704:88 , srv151294591:89 , srv1567329293:89 , srv1927904734:89 , srv1934629086:89 , srv356589709:89 , srv374048309:89 , srv397742484:89 , srv400909509:89 , srv913384193:89 , srv941163118:89 , srv962636466:89 , srv1382840554:90 , srv1646247741:90 , srv1715092217:90 , srv1927041700:90 , srv2124178801:90 , srv472972755:92 , srv1333596561:518 }
2023-04-17 10:53:36,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 10:53:36,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv166764077=29, srv151294591=19, srv1296772496=12, srv1077296838=3, srv2124178801=58, srv400909509=68, srv956171811=97, srv1155085411=7, srv637213479=83, srv789134534=90, srv1215818124=8, srv610719501=81, srv571548650=77, srv356589709=63, srv592045145=79, srv171435662=31, srv97178431=99, srv1721909937=33, srv184560774=42, srv319574754=62, srv774900704=87, srv368515174=64, srv2097357319=57, srv599548595=80, srv1867814178=44, srv773413968=86, srv962636466=98, srv1567329293=23, srv472972755=71, srv397742484=67, srv1522318948=21, srv1934629086=51, srv1036489055=1, srv1333596561=13, srv1743147943=34, srv421363471=69, srv1927041700=49, srv1520496715=20, srv1094584594=4, srv54812660=74, srv1715092217=32, srv103536864=0, srv1385243665=17, srv1911785235=45, srv1927904734=50, srv1272736673=10, srv159112989=25, srv1376342077=15, srv1643441811=27, srv2021926878=53, srv1914544052=47, srv1646247741=28, srv1593061065=26, srv903351578=91, srv1542792884=22, srv455079721=70, srv1984116909=52, srv168090709=30, srv1856114229=43, srv374048309=65, srv916485521=93, srv549499509=75, srv715689846=84, srv582076514=78, srv2033059877=55, srv1913822245=46, srv941163118=95, srv1758844472=36, srv1151668370=6, srv1757334147=35, srv1230091316=9, srv1290495343=11, srv1765249756=37, srv1793837945=39, srv2040113115=56, srv1103948034=5, srv242066365=59, srv1824051623=40, srv616714649=82, srv1337513128=14, srv746752104=85, srv775349811=88, srv782845299=89, srv2031963137=54, srv269477038=61, srv552496213=76, srv913384193=92, srv263435141=60, srv382808340=66, srv1771043742=38, srv944666911=96, srv1419700475=18, srv928735166=94, srv476504011=72, srv1574521481=24, srv1833628712=41, srv1924943841=48, srv530896649=73, srv1382840554=16, srv1058765473=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 10:53:36,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 10:53:36,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 10:53:36,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 10:53:36,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 10:53:36,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 10:53:36,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 10:53:36,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 10:53:36,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 10:53:36,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 10:53:36,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 10:53:36,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 10:53:36,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 10:53:36,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 10:53:36,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 10:53:36,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 10:53:36,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 10:53:36,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 10:53:36,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 10:53:36,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 10:53:36,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 10:53:36,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 10:53:36,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 10:53:36,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 10:53:36,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 10:53:36,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 10:53:36,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 10:53:36,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 10:53:36,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 10:53:36,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 10:53:36,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 10:53:36,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-17 10:53:36,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-17 10:53:36,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-17 10:53:36,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-17 10:53:36,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-17 10:53:36,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-17 10:53:36,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-17 10:53:36,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-17 10:53:36,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-17 10:53:36,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-17 10:53:36,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-17 10:53:36,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-17 10:53:36,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-17 10:53:36,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-17 10:53:36,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-17 10:53:36,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-17 10:53:36,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-17 10:53:36,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-17 10:53:36,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-17 10:53:36,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-17 10:53:36,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-17 10:53:36,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-17 10:53:36,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-17 10:53:36,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-17 10:53:36,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-17 10:53:36,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-17 10:53:36,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-17 10:53:36,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-17 10:53:36,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-17 10:53:36,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-17 10:53:36,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-17 10:53:36,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-17 10:53:36,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-17 10:53:36,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-17 10:53:36,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-17 10:53:36,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-17 10:53:36,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-17 10:53:36,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-17 10:53:36,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-17 10:53:36,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-17 10:53:36,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-17 10:53:36,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-17 10:53:36,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-17 10:53:36,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-17 10:53:36,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-17 10:53:36,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-17 10:53:36,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-17 10:53:36,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-17 10:53:36,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-17 10:53:36,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-17 10:53:36,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-17 10:53:36,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-17 10:53:36,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-17 10:53:36,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-17 10:53:36,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-17 10:53:36,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-17 10:53:36,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-17 10:53:36,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-17 10:53:36,294 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023975191900414028); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036007232095614204, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023975191900414028); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04416666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:53:36,294 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-17 10:53:36,294 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014907049557644955, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023975191900414028); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036007232095614204, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023975191900414028); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04416666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-17 10:53:36,469 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 259 ms to try 5000 different iterations.  Found a solution that moves 968 regions; Going from a computed imbalance of 0.014907049557644955 to a new imbalance of 9.712961404057094E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009015650578634323); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011291465545440098); MoveCostFunction : (multiplier=7.0, imbalance=0.10755555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009015650578634323); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:53:36,471 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv637213479:80 , srv472972755:81 , srv1382840554:82 , srv1574521481:82 , srv2040113115:82 , srv1290495343:83 , srv1337513128:83 , srv1376342077:83 , srv1522318948:83 , srv1715092217:83 , srv1927904734:83 , srv2033059877:83 , srv400909509:83 , srv782845299:83 , srv1385243665:84 , srv1419700475:84 , srv159112989:84 , srv166764077:84 , srv1765249756:84 , srv2031963137:84 , srv263435141:84 , srv356589709:84 , srv382808340:84 , srv397742484:84 , srv616714649:84 , srv746752104:84 , srv774900704:84 , srv962636466:84 , srv97178431:84 , srv1077296838:85 , srv1151668370:85 , srv1230091316:85 , srv1567329293:85 , srv1757334147:85 , srv1824051623:85 , srv1833628712:85 , srv1914544052:85 , srv1927041700:85 , srv1934629086:85 , srv2124178801:85 , srv374048309:85 , srv421363471:85 , srv455079721:85 , srv552496213:85 , srv571548650:85 , srv610719501:85 , srv773413968:85 , srv913384193:85 , srv928735166:85 , srv941163118:85 , srv944666911:85 , srv956171811:85 , srv1058765473:86 , srv1103948034:86 , srv151294591:86 , srv1520496715:86 , srv1542792884:86 , srv1643441811:86 , srv1646247741:86 , srv171435662:86 , srv1721909937:86 , srv1793837945:86 , srv1867814178:86 , srv1913822245:86 , srv269477038:86 , srv368515174:86 , srv530896649:86 , srv582076514:86 , srv599548595:86 , srv715689846:86 , srv789134534:86 , srv903351578:86 , srv916485521:86 , srv1036489055:87 , srv1094584594:87 , srv1215818124:87 , srv1272736673:87 , srv1743147943:87 , srv1758844472:87 , srv1771043742:87 , srv184560774:87 , srv1856114229:87 , srv1924943841:87 , srv1984116909:87 , srv2021926878:87 , srv2097357319:87 , srv319574754:87 , srv476504011:87 , srv592045145:87 , srv103536864:88 , srv1155085411:88 , srv1296772496:88 , srv1593061065:88 , srv168090709:88 , srv1911785235:88 , srv242066365:88 , srv549499509:88 , srv54812660:89 , srv775349811:89 , srv1333596561:551 }
2023-04-17 10:53:36,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 10:53:36,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv166764077=29, srv151294591=19, srv1296772496=12, srv1077296838=3, srv2124178801=58, srv400909509=68, srv956171811=97, srv1155085411=7, srv637213479=83, srv789134534=90, srv1215818124=8, srv610719501=81, srv571548650=77, srv356589709=63, srv592045145=79, srv171435662=31, srv97178431=99, srv1721909937=33, srv184560774=42, srv319574754=62, srv774900704=87, srv368515174=64, srv2097357319=57, srv599548595=80, srv1867814178=44, srv773413968=86, srv962636466=98, srv1567329293=23, srv472972755=71, srv397742484=67, srv1522318948=21, srv1934629086=51, srv1036489055=1, srv1333596561=13, srv1743147943=34, srv421363471=69, srv1927041700=49, srv1520496715=20, srv1094584594=4, srv54812660=74, srv1715092217=32, srv103536864=0, srv1385243665=17, srv1911785235=45, srv1927904734=50, srv1272736673=10, srv159112989=25, srv1376342077=15, srv1643441811=27, srv2021926878=53, srv1914544052=47, srv1646247741=28, srv1593061065=26, srv903351578=91, srv1542792884=22, srv455079721=70, srv1984116909=52, srv168090709=30, srv1856114229=43, srv374048309=65, srv916485521=93, srv549499509=75, srv715689846=84, srv582076514=78, srv2033059877=55, srv1913822245=46, srv941163118=95, srv1758844472=36, srv1151668370=6, srv1757334147=35, srv1230091316=9, srv1290495343=11, srv1765249756=37, srv1793837945=39, srv2040113115=56, srv1103948034=5, srv242066365=59, srv1824051623=40, srv616714649=82, srv1337513128=14, srv746752104=85, srv775349811=88, srv782845299=89, srv2031963137=54, srv269477038=61, srv552496213=76, srv913384193=92, srv263435141=60, srv382808340=66, srv1771043742=38, srv944666911=96, srv1419700475=18, srv928735166=94, srv476504011=72, srv1574521481=24, srv1833628712=41, srv1924943841=48, srv530896649=73, srv1382840554=16, srv1058765473=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 10:53:36,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 10:53:36,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 10:53:36,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 10:53:36,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 10:53:36,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 10:53:36,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 10:53:36,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 10:53:36,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 10:53:36,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-17 10:53:36,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-17 10:53:36,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-17 10:53:36,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-17 10:53:36,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-17 10:53:36,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-17 10:53:36,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-17 10:53:36,570 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009015650578634323); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011291465545440098); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009015650578634323); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:53:36,570 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-17 10:53:36,570 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.645180595348819E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009015650578634323); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011291465545440098); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009015650578634323); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004666666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-17 10:53:36,826 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 328 ms to try 5000 different iterations.  Found a solution that moves 290 regions; Going from a computed imbalance of 9.645180595348819E-4 to a new imbalance of 3.5846079852877385E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.03222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:53:36,827 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1646247741:83 , srv1927041700:83 , srv2124178801:83 , srv1151668370:84 , srv1155085411:84 , srv1296772496:84 , srv1337513128:84 , srv1382840554:84 , srv1643441811:84 , srv171435662:84 , srv1721909937:84 , srv1856114229:84 , srv1924943841:84 , srv1927904734:84 , srv1984116909:84 , srv2021926878:84 , srv2033059877:84 , srv2097357319:84 , srv242066365:84 , srv263435141:84 , srv319574754:84 , srv368515174:84 , srv54812660:84 , srv549499509:84 , srv571548650:84 , srv582076514:84 , srv592045145:84 , srv610719501:84 , srv715689846:84 , srv773413968:84 , srv775349811:84 , srv782845299:84 , srv913384193:84 , srv928735166:84 , srv944666911:84 , srv962636466:84 , srv103536864:85 , srv1036489055:85 , srv1058765473:85 , srv1077296838:85 , srv1094584594:85 , srv1272736673:85 , srv1290495343:85 , srv1376342077:85 , srv1419700475:85 , srv151294591:85 , srv1520496715:85 , srv1542792884:85 , srv1567329293:85 , srv159112989:85 , srv1593061065:85 , srv166764077:85 , srv168090709:85 , srv1715092217:85 , srv1757334147:85 , srv1758844472:85 , srv1771043742:85 , srv1793837945:85 , srv1824051623:85 , srv1833628712:85 , srv184560774:85 , srv1911785235:85 , srv1913822245:85 , srv1934629086:85 , srv2040113115:85 , srv269477038:85 , srv374048309:85 , srv400909509:85 , srv421363471:85 , srv455079721:85 , srv530896649:85 , srv552496213:85 , srv599548595:85 , srv774900704:85 , srv789134534:85 , srv903351578:85 , srv916485521:85 , srv941163118:85 , srv956171811:85 , srv1103948034:86 , srv1215818124:86 , srv1230091316:86 , srv1385243665:86 , srv1522318948:86 , srv1574521481:86 , srv1743147943:86 , srv1765249756:86 , srv1867814178:86 , srv1914544052:86 , srv2031963137:86 , srv356589709:86 , srv382808340:86 , srv397742484:86 , srv472972755:86 , srv476504011:86 , srv616714649:86 , srv637213479:86 , srv746752104:86 , srv97178431:86 , srv1333596561:604 }
2023-04-17 10:53:36,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 10:53:36,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv166764077=29, srv151294591=19, srv1296772496=12, srv1077296838=3, srv2124178801=58, srv400909509=68, srv956171811=97, srv1155085411=7, srv637213479=83, srv789134534=90, srv1215818124=8, srv610719501=81, srv571548650=77, srv356589709=63, srv592045145=79, srv171435662=31, srv97178431=99, srv1721909937=33, srv184560774=42, srv319574754=62, srv774900704=87, srv368515174=64, srv2097357319=57, srv599548595=80, srv1867814178=44, srv773413968=86, srv962636466=98, srv1567329293=23, srv472972755=71, srv397742484=67, srv1522318948=21, srv1934629086=51, srv1036489055=1, srv1333596561=13, srv1743147943=34, srv421363471=69, srv1927041700=49, srv1520496715=20, srv1094584594=4, srv54812660=74, srv1715092217=32, srv103536864=0, srv1385243665=17, srv1911785235=45, srv1927904734=50, srv1272736673=10, srv159112989=25, srv1376342077=15, srv1643441811=27, srv2021926878=53, srv1914544052=47, srv1646247741=28, srv1593061065=26, srv903351578=91, srv1542792884=22, srv455079721=70, srv1984116909=52, srv168090709=30, srv1856114229=43, srv374048309=65, srv916485521=93, srv549499509=75, srv715689846=84, srv582076514=78, srv2033059877=55, srv1913822245=46, srv941163118=95, srv1758844472=36, srv1151668370=6, srv1757334147=35, srv1230091316=9, srv1290495343=11, srv1765249756=37, srv1793837945=39, srv2040113115=56, srv1103948034=5, srv242066365=59, srv1824051623=40, srv616714649=82, srv1337513128=14, srv746752104=85, srv775349811=88, srv782845299=89, srv2031963137=54, srv269477038=61, srv552496213=76, srv913384193=92, srv263435141=60, srv382808340=66, srv1771043742=38, srv944666911=96, srv1419700475=18, srv928735166=94, srv476504011=72, srv1574521481=24, srv1833628712=41, srv1924943841=48, srv530896649=73, srv1382840554=16, srv1058765473=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 10:53:36,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 10:53:36,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 10:53:36,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 10:53:36,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 10:53:36,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 10:53:36,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 10:53:36,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 10:53:36,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 10:53:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 10:53:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 10:53:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 10:53:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 10:53:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 10:53:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 10:53:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 10:53:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 10:53:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 10:53:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 10:53:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 10:53:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 10:53:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 10:53:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 10:53:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 10:53:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 10:53:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 10:53:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 10:53:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 10:53:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 10:53:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 10:53:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 10:53:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-17 10:53:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-17 10:53:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-17 10:53:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-17 10:53:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-17 10:53:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-17 10:53:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-17 10:53:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-17 10:53:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-17 10:53:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-17 10:53:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-17 10:53:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-17 10:53:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-17 10:53:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-17 10:53:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-17 10:53:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-17 10:53:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-17 10:53:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-17 10:53:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-17 10:53:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-17 10:53:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-17 10:53:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-17 10:53:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-17 10:53:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-17 10:53:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-17 10:53:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-17 10:53:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-17 10:53:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-17 10:53:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-17 10:53:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-17 10:53:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-17 10:53:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-17 10:53:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-17 10:53:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-17 10:53:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-17 10:53:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-17 10:53:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-17 10:53:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-17 10:53:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-17 10:53:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-17 10:53:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-17 10:53:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-17 10:53:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-17 10:53:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-17 10:53:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-17 10:53:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-17 10:53:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-17 10:53:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-17 10:53:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-17 10:53:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-17 10:53:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-17 10:53:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-17 10:53:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-17 10:53:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-17 10:53:36,934 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:53:36,934 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-17 10:53:36,934 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.381545645149316E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-17 10:53:37,085 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 225 ms to try 5000 different iterations.  Found a solution that moves 36 regions; Going from a computed imbalance of 3.381545645149316E-5 to a new imbalance of 6.284156127486411E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.004); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:53:37,086 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1094584594:83 , srv1215818124:83 , srv1522318948:83 , srv1743147943:83 , srv1914544052:83 , srv356589709:83 , srv476504011:83 , srv103536864:84 , srv1036489055:84 , srv1058765473:84 , srv1077296838:84 , srv1103948034:84 , srv1151668370:84 , srv1155085411:84 , srv1230091316:84 , srv1272736673:84 , srv1290495343:84 , srv1296772496:84 , srv1376342077:84 , srv1382840554:84 , srv1385243665:84 , srv1419700475:84 , srv151294591:84 , srv1520496715:84 , srv1542792884:84 , srv1567329293:84 , srv1574521481:84 , srv159112989:84 , srv1593061065:84 , srv1643441811:84 , srv1646247741:84 , srv166764077:84 , srv168090709:84 , srv1715092217:84 , srv1757334147:84 , srv1758844472:84 , srv1765249756:84 , srv1771043742:84 , srv1793837945:84 , srv1824051623:84 , srv1833628712:84 , srv184560774:84 , srv1856114229:84 , srv1867814178:84 , srv1911785235:84 , srv1913822245:84 , srv1924943841:84 , srv1927041700:84 , srv1927904734:84 , srv1934629086:84 , srv2021926878:84 , srv2031963137:84 , srv2033059877:84 , srv2040113115:84 , srv2097357319:84 , srv2124178801:84 , srv242066365:84 , srv263435141:84 , srv269477038:84 , srv319574754:84 , srv368515174:84 , srv374048309:84 , srv382808340:84 , srv397742484:84 , srv400909509:84 , srv421363471:84 , srv455079721:84 , srv472972755:84 , srv530896649:84 , srv54812660:84 , srv549499509:84 , srv552496213:84 , srv571548650:84 , srv582076514:84 , srv592045145:84 , srv610719501:84 , srv616714649:84 , srv637213479:84 , srv715689846:84 , srv746752104:84 , srv773413968:84 , srv774900704:84 , srv775349811:84 , srv789134534:84 , srv903351578:84 , srv913384193:84 , srv916485521:84 , srv928735166:84 , srv941163118:84 , srv944666911:84 , srv962636466:84 , srv97178431:84 , srv1337513128:85 , srv171435662:85 , srv1721909937:85 , srv1984116909:85 , srv599548595:85 , srv782845299:85 , srv956171811:85 , srv1333596561:684 }
2023-04-17 10:53:37,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 10:53:37,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv166764077=29, srv151294591=19, srv1296772496=12, srv1077296838=3, srv2124178801=58, srv400909509=68, srv956171811=97, srv1155085411=7, srv637213479=83, srv789134534=90, srv1215818124=8, srv610719501=81, srv571548650=77, srv356589709=63, srv592045145=79, srv171435662=31, srv97178431=99, srv1721909937=33, srv184560774=42, srv319574754=62, srv774900704=87, srv368515174=64, srv2097357319=57, srv599548595=80, srv1867814178=44, srv773413968=86, srv962636466=98, srv1567329293=23, srv472972755=71, srv397742484=67, srv1522318948=21, srv1934629086=51, srv1036489055=1, srv1333596561=13, srv1743147943=34, srv421363471=69, srv1927041700=49, srv1520496715=20, srv1094584594=4, srv54812660=74, srv1715092217=32, srv103536864=0, srv1385243665=17, srv1911785235=45, srv1927904734=50, srv1272736673=10, srv159112989=25, srv1376342077=15, srv1643441811=27, srv2021926878=53, srv1914544052=47, srv1646247741=28, srv1593061065=26, srv903351578=91, srv1542792884=22, srv455079721=70, srv1984116909=52, srv168090709=30, srv1856114229=43, srv374048309=65, srv916485521=93, srv549499509=75, srv715689846=84, srv582076514=78, srv2033059877=55, srv1913822245=46, srv941163118=95, srv1758844472=36, srv1151668370=6, srv1757334147=35, srv1230091316=9, srv1290495343=11, srv1765249756=37, srv1793837945=39, srv2040113115=56, srv1103948034=5, srv242066365=59, srv1824051623=40, srv616714649=82, srv1337513128=14, srv746752104=85, srv775349811=88, srv782845299=89, srv2031963137=54, srv269477038=61, srv552496213=76, srv913384193=92, srv263435141=60, srv382808340=66, srv1771043742=38, srv944666911=96, srv1419700475=18, srv928735166=94, srv476504011=72, srv1574521481=24, srv1833628712=41, srv1924943841=48, srv530896649=73, srv1382840554=16, srv1058765473=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 10:53:37,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 10:53:37,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-17 10:53:37,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-17 10:53:37,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-17 10:53:37,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-17 10:53:37,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-17 10:53:37,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-17 10:53:37,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-17 10:53:37,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-17 10:53:37,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-17 10:53:37,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-17 10:53:37,181 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:53:37,181 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1094584594:83 , srv1215818124:83 , srv1522318948:83 , srv1743147943:83 , srv1914544052:83 , srv356589709:83 , srv476504011:83 , srv103536864:84 , srv1036489055:84 , srv1058765473:84 , srv1077296838:84 , srv1103948034:84 , srv1151668370:84 , srv1155085411:84 , srv1230091316:84 , srv1272736673:84 , srv1290495343:84 , srv1296772496:84 , srv1376342077:84 , srv1382840554:84 , srv1385243665:84 , srv1419700475:84 , srv151294591:84 , srv1520496715:84 , srv1542792884:84 , srv1567329293:84 , srv1574521481:84 , srv159112989:84 , srv1593061065:84 , srv1643441811:84 , srv1646247741:84 , srv166764077:84 , srv168090709:84 , srv1715092217:84 , srv1757334147:84 , srv1758844472:84 , srv1765249756:84 , srv1771043742:84 , srv1793837945:84 , srv1824051623:84 , srv1833628712:84 , srv184560774:84 , srv1856114229:84 , srv1867814178:84 , srv1911785235:84 , srv1913822245:84 , srv1924943841:84 , srv1927041700:84 , srv1927904734:84 , srv1934629086:84 , srv2021926878:84 , srv2031963137:84 , srv2033059877:84 , srv2040113115:84 , srv2097357319:84 , srv2124178801:84 , srv242066365:84 , srv263435141:84 , srv269477038:84 , srv319574754:84 , srv368515174:84 , srv374048309:84 , srv382808340:84 , srv397742484:84 , srv400909509:84 , srv421363471:84 , srv455079721:84 , srv472972755:84 , srv530896649:84 , srv54812660:84 , srv549499509:84 , srv552496213:84 , srv571548650:84 , srv582076514:84 , srv592045145:84 , srv610719501:84 , srv616714649:84 , srv637213479:84 , srv715689846:84 , srv746752104:84 , srv773413968:84 , srv774900704:84 , srv775349811:84 , srv789134534:84 , srv903351578:84 , srv913384193:84 , srv916485521:84 , srv928735166:84 , srv941163118:84 , srv944666911:84 , srv962636466:84 , srv97178431:84 , srv1337513128:85 , srv171435662:85 , srv1721909937:85 , srv1984116909:85 , srv599548595:85 , srv782845299:85 , srv956171811:85 , srv1333596561:684 }
2023-04-17 10:53:37,201 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=459 (was 463), ProcessCount=170 (was 170), AvailableMemoryMB=8526 (was 8998)
2023-04-17 10:53:37,207 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=459, ProcessCount=170, AvailableMemoryMB=8526
2023-04-17 10:53:37,208 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-17 10:53:37,208 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-17 10:53:37,216 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1023842174:84 , srv1045446814:84 , srv111503703:84 , srv1136313495:84 , srv1164734267:84 , srv1216330438:84 , srv1415250287:84 , srv1420298575:84 , srv1454532720:84 , srv1465536655:84 , srv1469415814:84 , srv159683754:84 , srv1644614063:84 , srv1741079482:84 , srv1741165165:84 , srv1903027584:84 , srv2036182179:84 , srv2141876251:84 , srv31061946:84 , srv423656446:84 , srv496090894:84 , srv695910456:84 , srv735635501:84 , srv789932429:84 , srv80970606:84 , srv90620961:84 , srv94221885:84 , srv966357343:84 , srv979198552:84 , srv1154959721:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-17 10:53:37,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 10:53:37,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1469415814=11, srv1644614063=13, srv90620961=26, srv966357343=28, srv1454532720=9, srv1741079482=14, srv111503703=2, srv1023842174=0, srv1465536655=10, srv159683754=12, srv1136313495=3, srv80970606=25, srv1154959721=4, srv2141876251=18, srv496090894=21, srv1045446814=1, srv1216330438=6, srv31061946=19, srv2036182179=17, srv735635501=23, srv789932429=24, srv1415250287=7, srv695910456=22, srv423656446=20, srv1420298575=8, srv1741165165=15, srv1903027584=16, srv94221885=27, srv979198552=29, srv1164734267=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 10:53:37,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 10:53:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 10:53:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 10:53:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 10:53:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 10:53:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 10:53:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 10:53:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 10:53:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 10:53:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 10:53:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 10:53:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 10:53:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-17 10:53:37,243 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0659339043809881, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:53:37,243 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912400798844044, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0659339043809881, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-17 10:55:37,230 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9550364 different iterations.  Found a solution that moves 1834 regions; Going from a computed imbalance of 0.9912400798844044 to a new imbalance of 4.280647492113412E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6792592592592592, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:55:37,235 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1023842174:90 , srv1045446814:90 , srv111503703:90 , srv1136313495:90 , srv1154959721:90 , srv1164734267:90 , srv1216330438:90 , srv1415250287:90 , srv1420298575:90 , srv1454532720:90 , srv1465536655:90 , srv1469415814:90 , srv159683754:90 , srv1644614063:90 , srv1741079482:90 , srv1741165165:90 , srv1903027584:90 , srv2036182179:90 , srv2141876251:90 , srv31061946:90 , srv423656446:90 , srv496090894:90 , srv695910456:90 , srv735635501:90 , srv789932429:90 , srv80970606:90 , srv90620961:90 , srv94221885:90 , srv966357343:90 , srv979198552:90 }
2023-04-17 10:55:37,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-17 10:55:37,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1469415814=11, srv1644614063=13, srv90620961=26, srv966357343=28, srv1454532720=9, srv1741079482=14, srv111503703=2, srv1023842174=0, srv1465536655=10, srv159683754=12, srv1136313495=3, srv80970606=25, srv1154959721=4, srv2141876251=18, srv496090894=21, srv1045446814=1, srv1216330438=6, srv31061946=19, srv2036182179=17, srv735635501=23, srv789932429=24, srv1415250287=7, srv695910456=22, srv423656446=20, srv1420298575=8, srv1741165165=15, srv1903027584=16, srv94221885=27, srv979198552=29, srv1164734267=5} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-17 10:55:37,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-17 10:55:37,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-17 10:55:37,249 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-17 10:55:37,249 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1023842174:90 , srv1045446814:90 , srv111503703:90 , srv1136313495:90 , srv1154959721:90 , srv1164734267:90 , srv1216330438:90 , srv1415250287:90 , srv1420298575:90 , srv1454532720:90 , srv1465536655:90 , srv1469415814:90 , srv159683754:90 , srv1644614063:90 , srv1741079482:90 , srv1741165165:90 , srv1903027584:90 , srv2036182179:90 , srv2141876251:90 , srv31061946:90 , srv423656446:90 , srv496090894:90 , srv695910456:90 , srv735635501:90 , srv789932429:90 , srv80970606:90 , srv90620961:90 , srv94221885:90 , srv966357343:90 , srv979198552:90 }
2023-04-17 10:55:37,259 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 459), ProcessCount=168 (was 170), AvailableMemoryMB=8611 (was 8526) - AvailableMemoryMB LEAK? -