2023-12-23 15:56:10,991 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-23 15:56:11,252 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-23 15:56:11,345 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-23 15:56:11,400 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-23 15:56:11,406 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-23 15:56:11,417 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=128, ProcessCount=175, AvailableMemoryMB=3656
2023-12-23 15:56:11,418 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-23 15:56:11,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-23 15:56:11,526 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1006100417:84 , srv1007205619:84 , srv1092324358:84 , srv1100578152:84 , srv1100738684:84 , srv1108120975:84 , srv1141539817:84 , srv1195517892:84 , srv1218844899:84 , srv1231871076:84 , srv1245078838:84 , srv1250347432:84 , srv1259398504:84 , srv1272132461:84 , srv1275595776:84 , srv1286894694:84 , srv1310361266:84 , srv1330133332:84 , srv1357739161:84 , srv1400133203:84 , srv1418307540:84 , srv1419444489:84 , srv1434853091:84 , srv1442084339:84 , srv145018672:84 , srv1504327691:84 , srv1537742216:84 , srv154188338:84 , srv1569124822:84 , srv1600668595:84 , srv1606417328:84 , srv1684606391:84 , srv1684894545:84 , srv1711982919:84 , srv1718798160:84 , srv1801099798:84 , srv1808468065:84 , srv1813655576:84 , srv1843216535:84 , srv1855469680:84 , srv1867021617:84 , srv188084989:84 , srv1904110323:84 , srv192169762:84 , srv1932089865:84 , srv1937534931:84 , srv1960526093:84 , srv1963044698:84 , srv1965255835:84 , srv2028713905:84 , srv2080261220:84 , srv2100527132:84 , srv2113901:84 , srv2115415184:84 , srv212481424:84 , srv2143539415:84 , srv22640933:84 , srv233637046:84 , srv273682298:84 , srv293971880:84 , srv31779750:84 , srv338110395:84 , srv350400946:84 , srv355401120:84 , srv355633008:84 , srv455283470:84 , srv461735432:84 , srv509691508:84 , srv584312721:84 , srv600681751:84 , srv609805100:84 , srv61270348:84 , srv622403885:84 , srv650288736:84 , srv652554495:84 , srv661133572:84 , srv673491423:84 , srv697008470:84 , srv706351619:84 , srv731485073:84 , srv744963736:84 , srv755132809:84 , srv756168847:84 , srv75895080:84 , srv764226702:84 , srv770702461:84 , srv794375301:84 , srv809356411:84 , srv820831029:84 , srv863300102:84 , srv88856628:84 , srv902520409:84 , srv917064239:84 , srv927827336:84 , srv934083959:84 , srv939679933:84 , srv946774078:84 , srv948699970:84 , srv965767291:84 , srv242719301:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-23 15:56:11,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-23 15:56:11,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv145018672=24, srv61270348=72, srv1250347432=11, srv154188338=27, srv461735432=67, srv1711982919=33, srv31779750=61, srv1504327691=25, srv293971880=60, srv744963736=81, srv706351619=79, srv820831029=89, srv1218844899=8, srv192169762=43, srv1904110323=42, srv22640933=56, srv2143539415=55, srv1100738684=4, srv1286894694=15, srv1400133203=19, srv1434853091=22, srv934083959=95, srv188084989=41, srv863300102=90, srv1684894545=32, srv1718798160=34, srv1100578152=3, srv1606417328=30, srv2115415184=53, srv731485073=80, srv1108120975=5, srv1813655576=37, srv1272132461=13, srv1245078838=10, srv756168847=83, srv1537742216=26, srv1801099798=35, srv1932089865=44, srv584312721=69, srv794375301=87, srv2113901=52, srv1330133332=17, srv609805100=71, srv755132809=82, srv1808468065=36, srv509691508=68, srv88856628=91, srv770702461=86, srv650288736=74, srv1937534931=45, srv1195517892=7, srv350400946=63, srv946774078=97, srv1963044698=47, srv1418307540=20, srv355633008=65, srv1684606391=31, srv1867021617=40, srv212481424=54, srv917064239=93, srv273682298=59, srv927827336=94, srv233637046=57, srv355401120=64, srv661133572=76, srv75895080=84, srv338110395=62, srv600681751=70, srv764226702=85, srv1141539817=6, srv673491423=77, srv1600668595=29, srv2028713905=49, srv2080261220=50, srv1569124822=28, srv1231871076=9, srv1843216535=38, srv622403885=73, srv1442084339=23, srv1960526093=46, srv1092324358=2, srv242719301=58, srv697008470=78, srv652554495=75, srv1357739161=18, srv1006100417=0, srv1965255835=48, srv2100527132=51, srv455283470=66, srv1310361266=16, srv1855469680=39, srv809356411=88, srv1259398504=12, srv948699970=98, srv1275595776=14, srv1007205619=1, srv965767291=99, srv1419444489=21, srv939679933=96, srv902520409=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-23 15:56:11,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-23 15:56:11,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-23 15:56:11,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-23 15:56:11,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-23 15:56:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-23 15:56:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-23 15:56:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-23 15:56:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-23 15:56:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-23 15:56:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-23 15:56:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-23 15:56:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-23 15:56:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-23 15:56:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-23 15:56:11,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-23 15:56:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-23 15:56:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-23 15:56:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-23 15:56:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-23 15:56:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-23 15:56:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-23 15:56:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-23 15:56:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-23 15:56:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-23 15:56:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-23 15:56:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-23 15:56:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-23 15:56:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-23 15:56:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-23 15:56:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-23 15:56:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-23 15:56:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-23 15:56:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-23 15:56:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-23 15:56:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-23 15:56:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-23 15:56:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-23 15:56:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-23 15:56:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-23 15:56:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-23 15:56:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-23 15:56:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-23 15:56:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-23 15:56:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-23 15:56:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-23 15:56:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-23 15:56:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-23 15:56:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-23 15:56:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-23 15:56:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-23 15:56:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-23 15:56:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-23 15:56:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-23 15:56:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-23 15:56:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-23 15:56:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-23 15:56:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-23 15:56:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-23 15:56:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-23 15:56:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-23 15:56:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-23 15:56:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-23 15:56:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-23 15:56:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-23 15:56:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-23 15:56:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-23 15:56:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-23 15:56:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-23 15:56:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-23 15:56:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-23 15:56:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-23 15:56:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-23 15:56:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-23 15:56:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-23 15:56:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-23 15:56:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-23 15:56:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-23 15:56:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-23 15:56:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-23 15:56:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-23 15:56:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-23 15:56:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-23 15:56:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-23 15:56:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-23 15:56:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-23 15:56:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-23 15:56:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-23 15:56:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-23 15:56:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-23 15:56:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-23 15:56:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-23 15:56:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-23 15:56:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-23 15:56:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-23 15:56:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-23 15:56:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-23 15:56:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-23 15:56:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-23 15:56:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-23 15:56:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-23 15:56:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-23 15:56:11,758 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:56:11,759 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-23 15:56:11,759 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-23 15:56:12,013 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 381 ms to try 5000 different iterations.  Found a solution that moves 4752 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17181701252126175. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04165218603592455, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057876760589947354, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.528, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04165218603592455, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16725, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2305, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:56:12,024 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1272132461:82 , srv1684894545:82 , srv661133572:82 , srv934083959:82 , srv1006100417:83 , srv1007205619:83 , srv1092324358:83 , srv1711982919:83 , srv1801099798:83 , srv1963044698:83 , srv1965255835:83 , srv2113901:83 , srv293971880:83 , srv88856628:83 , srv1218844899:84 , srv154188338:84 , srv1855469680:84 , srv1904110323:84 , srv584312721:84 , srv609805100:84 , srv650288736:84 , srv731485073:84 , srv917064239:84 , srv1100578152:85 , srv1100738684:85 , srv1330133332:85 , srv1419444489:85 , srv1434853091:85 , srv1442084339:85 , srv145018672:85 , srv1606417328:85 , srv1808468065:85 , srv1813655576:85 , srv1867021617:85 , srv2080261220:85 , srv2115415184:85 , srv22640933:85 , srv233637046:85 , srv273682298:85 , srv350400946:85 , srv355401120:85 , srv355633008:85 , srv461735432:85 , srv509691508:85 , srv622403885:85 , srv755132809:85 , srv756168847:85 , srv75895080:85 , srv764226702:85 , srv1108120975:86 , srv1195517892:86 , srv1231871076:86 , srv1259398504:86 , srv1286894694:86 , srv1357739161:86 , srv1400133203:86 , srv1418307540:86 , srv1504327691:86 , srv1600668595:86 , srv192169762:86 , srv1937534931:86 , srv1960526093:86 , srv31779750:86 , srv965767291:86 , srv1250347432:87 , srv1537742216:87 , srv1569124822:87 , srv1843216535:87 , srv1932089865:87 , srv2143539415:87 , srv338110395:87 , srv652554495:87 , srv770702461:87 , srv794375301:87 , srv902520409:87 , srv939679933:87 , srv1275595776:88 , srv2028713905:88 , srv2100527132:88 , srv600681751:88 , srv1245078838:89 , srv1310361266:89 , srv673491423:89 , srv706351619:89 , srv809356411:89 , srv820831029:89 , srv946774078:89 , srv1684606391:90 , srv61270348:90 , srv927827336:90 , srv948699970:90 , srv744963736:91 , srv1718798160:92 , srv188084989:92 , srv212481424:92 , srv697008470:93 , srv863300102:93 , srv455283470:96 , srv1141539817:98 , srv242719301:460 }
2023-12-23 15:56:12,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-23 15:56:12,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv145018672=24, srv61270348=72, srv1250347432=11, srv154188338=27, srv461735432=67, srv1711982919=33, srv31779750=61, srv1504327691=25, srv293971880=60, srv744963736=81, srv706351619=79, srv820831029=89, srv1218844899=8, srv192169762=43, srv1904110323=42, srv22640933=56, srv2143539415=55, srv1100738684=4, srv1286894694=15, srv1400133203=19, srv1434853091=22, srv934083959=95, srv188084989=41, srv863300102=90, srv1684894545=32, srv1718798160=34, srv1100578152=3, srv1606417328=30, srv2115415184=53, srv731485073=80, srv1108120975=5, srv1813655576=37, srv1272132461=13, srv1245078838=10, srv756168847=83, srv1537742216=26, srv1801099798=35, srv1932089865=44, srv584312721=69, srv794375301=87, srv2113901=52, srv1330133332=17, srv609805100=71, srv755132809=82, srv1808468065=36, srv509691508=68, srv88856628=91, srv770702461=86, srv650288736=74, srv1937534931=45, srv1195517892=7, srv350400946=63, srv946774078=97, srv1963044698=47, srv1418307540=20, srv355633008=65, srv1684606391=31, srv1867021617=40, srv212481424=54, srv917064239=93, srv273682298=59, srv927827336=94, srv233637046=57, srv355401120=64, srv661133572=76, srv75895080=84, srv338110395=62, srv600681751=70, srv764226702=85, srv1141539817=6, srv673491423=77, srv1600668595=29, srv2028713905=49, srv2080261220=50, srv1569124822=28, srv1231871076=9, srv1843216535=38, srv622403885=73, srv1442084339=23, srv1960526093=46, srv1092324358=2, srv242719301=58, srv697008470=78, srv652554495=75, srv1357739161=18, srv1006100417=0, srv1965255835=48, srv2100527132=51, srv455283470=66, srv1310361266=16, srv1855469680=39, srv809356411=88, srv1259398504=12, srv948699970=98, srv1275595776=14, srv1007205619=1, srv965767291=99, srv1419444489=21, srv939679933=96, srv902520409=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-23 15:56:12,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-23 15:56:12,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-23 15:56:12,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-23 15:56:12,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-23 15:56:12,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-23 15:56:12,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-23 15:56:12,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-23 15:56:12,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-23 15:56:12,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-23 15:56:12,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-23 15:56:12,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-23 15:56:12,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-23 15:56:12,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-23 15:56:12,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-23 15:56:12,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-23 15:56:12,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-23 15:56:12,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-23 15:56:12,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-23 15:56:12,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-23 15:56:12,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-23 15:56:12,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-23 15:56:12,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-23 15:56:12,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-23 15:56:12,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-23 15:56:12,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-23 15:56:12,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-23 15:56:12,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-23 15:56:12,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-23 15:56:12,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-23 15:56:12,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-23 15:56:12,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-23 15:56:12,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-23 15:56:12,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-23 15:56:12,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-23 15:56:12,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-23 15:56:12,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-23 15:56:12,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-23 15:56:12,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-23 15:56:12,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-23 15:56:12,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-23 15:56:12,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-23 15:56:12,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-23 15:56:12,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-23 15:56:12,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-23 15:56:12,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-23 15:56:12,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-23 15:56:12,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-23 15:56:12,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-23 15:56:12,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-23 15:56:12,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-23 15:56:12,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-23 15:56:12,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-23 15:56:12,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-23 15:56:12,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-23 15:56:12,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-23 15:56:12,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-23 15:56:12,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-23 15:56:12,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-23 15:56:12,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-23 15:56:12,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-23 15:56:12,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-23 15:56:12,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-23 15:56:12,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-23 15:56:12,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-23 15:56:12,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-23 15:56:12,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-23 15:56:12,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-23 15:56:12,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-23 15:56:12,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-23 15:56:12,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-23 15:56:12,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-23 15:56:12,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-23 15:56:12,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-23 15:56:12,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-23 15:56:12,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-23 15:56:12,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-23 15:56:12,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-23 15:56:12,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-23 15:56:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-23 15:56:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-23 15:56:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-23 15:56:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-23 15:56:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-23 15:56:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-23 15:56:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-23 15:56:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-23 15:56:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-23 15:56:12,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-23 15:56:12,158 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04165218603592455, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057876760589947354, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04165218603592455, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16725, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2305, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:56:12,159 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-23 15:56:12,159 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1717837383060777, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04165218603592455, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057876760589947354, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04165218603592455, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16725, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2305, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-23 15:56:12,326 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 248 ms to try 5000 different iterations.  Found a solution that moves 2591 regions; Going from a computed imbalance of 0.1717837383060777 to a new imbalance of 0.014204598825773272. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02341203125280817); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03652712965588547, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2878888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02341203125280817); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042833333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:56:12,334 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1141539817:73 , srv1718798160:77 , srv455283470:77 , srv863300102:78 , srv697008470:79 , srv1684606391:80 , srv61270348:80 , srv1310361266:81 , srv212481424:81 , srv744963736:81 , srv1245078838:82 , srv188084989:82 , srv2028713905:82 , srv673491423:82 , srv706351619:82 , srv820831029:82 , srv965767291:82 , srv1250347432:83 , srv1418307540:83 , srv1504327691:83 , srv902520409:83 , srv927827336:83 , srv948699970:83 , srv1275595776:84 , srv1419444489:84 , srv1569124822:84 , srv355401120:84 , srv509691508:84 , srv756168847:84 , srv794375301:84 , srv809356411:84 , srv939679933:84 , srv946774078:84 , srv350400946:85 , srv652554495:85 , srv1195517892:86 , srv1231871076:86 , srv1286894694:86 , srv1442084339:86 , srv1600668595:86 , srv192169762:86 , srv1932089865:86 , srv1960526093:86 , srv2080261220:86 , srv2100527132:86 , srv2143539415:86 , srv338110395:86 , srv461735432:86 , srv600681751:86 , srv755132809:86 , srv770702461:86 , srv88856628:86 , srv1272132461:87 , srv1330133332:87 , srv1357739161:87 , srv1400133203:87 , srv145018672:87 , srv1537742216:87 , srv1606417328:87 , srv1813655576:87 , srv1904110323:87 , srv1937534931:87 , srv2115415184:87 , srv31779750:87 , srv609805100:87 , srv650288736:87 , srv764226702:87 , srv917064239:87 , srv1092324358:88 , srv1100578152:88 , srv1100738684:88 , srv1108120975:88 , srv1218844899:88 , srv1801099798:88 , srv1808468065:88 , srv1855469680:88 , srv1867021617:88 , srv1963044698:88 , srv22640933:88 , srv233637046:88 , srv355633008:88 , srv622403885:88 , srv1259398504:89 , srv1434853091:89 , srv1684894545:89 , srv1711982919:89 , srv1843216535:89 , srv2113901:89 , srv293971880:89 , srv731485073:89 , srv75895080:89 , srv934083959:89 , srv1006100417:90 , srv154188338:90 , srv273682298:90 , srv661133572:90 , srv1007205619:91 , srv1965255835:91 , srv584312721:91 , srv242719301:522 }
2023-12-23 15:56:12,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-23 15:56:12,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv145018672=24, srv61270348=72, srv1250347432=11, srv154188338=27, srv461735432=67, srv1711982919=33, srv31779750=61, srv1504327691=25, srv293971880=60, srv744963736=81, srv706351619=79, srv820831029=89, srv1218844899=8, srv192169762=43, srv1904110323=42, srv22640933=56, srv2143539415=55, srv1100738684=4, srv1286894694=15, srv1400133203=19, srv1434853091=22, srv934083959=95, srv188084989=41, srv863300102=90, srv1684894545=32, srv1718798160=34, srv1100578152=3, srv1606417328=30, srv2115415184=53, srv731485073=80, srv1108120975=5, srv1813655576=37, srv1272132461=13, srv1245078838=10, srv756168847=83, srv1537742216=26, srv1801099798=35, srv1932089865=44, srv584312721=69, srv794375301=87, srv2113901=52, srv1330133332=17, srv609805100=71, srv755132809=82, srv1808468065=36, srv509691508=68, srv88856628=91, srv770702461=86, srv650288736=74, srv1937534931=45, srv1195517892=7, srv350400946=63, srv946774078=97, srv1963044698=47, srv1418307540=20, srv355633008=65, srv1684606391=31, srv1867021617=40, srv212481424=54, srv917064239=93, srv273682298=59, srv927827336=94, srv233637046=57, srv355401120=64, srv661133572=76, srv75895080=84, srv338110395=62, srv600681751=70, srv764226702=85, srv1141539817=6, srv673491423=77, srv1600668595=29, srv2028713905=49, srv2080261220=50, srv1569124822=28, srv1231871076=9, srv1843216535=38, srv622403885=73, srv1442084339=23, srv1960526093=46, srv1092324358=2, srv242719301=58, srv697008470=78, srv652554495=75, srv1357739161=18, srv1006100417=0, srv1965255835=48, srv2100527132=51, srv455283470=66, srv1310361266=16, srv1855469680=39, srv809356411=88, srv1259398504=12, srv948699970=98, srv1275595776=14, srv1007205619=1, srv965767291=99, srv1419444489=21, srv939679933=96, srv902520409=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-23 15:56:12,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-23 15:56:12,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-23 15:56:12,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-23 15:56:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-23 15:56:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-23 15:56:12,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-23 15:56:12,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-23 15:56:12,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-23 15:56:12,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-23 15:56:12,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-23 15:56:12,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-23 15:56:12,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-23 15:56:12,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-23 15:56:12,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-23 15:56:12,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-23 15:56:12,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-23 15:56:12,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-23 15:56:12,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-23 15:56:12,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-23 15:56:12,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-23 15:56:12,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-23 15:56:12,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-23 15:56:12,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-23 15:56:12,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-23 15:56:12,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-23 15:56:12,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-23 15:56:12,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-23 15:56:12,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-23 15:56:12,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-23 15:56:12,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-23 15:56:12,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-23 15:56:12,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-23 15:56:12,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-23 15:56:12,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-23 15:56:12,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-23 15:56:12,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-23 15:56:12,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-23 15:56:12,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-23 15:56:12,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-23 15:56:12,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-23 15:56:12,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-23 15:56:12,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-23 15:56:12,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-23 15:56:12,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-23 15:56:12,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-23 15:56:12,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-23 15:56:12,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-23 15:56:12,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-23 15:56:12,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-23 15:56:12,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-23 15:56:12,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-23 15:56:12,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-23 15:56:12,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-23 15:56:12,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-23 15:56:12,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-23 15:56:12,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-23 15:56:12,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-23 15:56:12,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-23 15:56:12,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-23 15:56:12,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-23 15:56:12,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-23 15:56:12,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-23 15:56:12,465 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02341203125280817); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03652712965588547, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02341203125280817); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042833333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:56:12,466 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-23 15:56:12,466 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014186456256004351, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02341203125280817); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03652712965588547, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02341203125280817); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042833333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-23 15:56:12,616 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 236 ms to try 5000 different iterations.  Found a solution that moves 989 regions; Going from a computed imbalance of 0.014186456256004351 to a new imbalance of 8.092080940341692E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005866707478686735); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008619660142094213); MoveCostFunction : (multiplier=7.0, imbalance=0.10988888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005866707478686735); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:56:12,618 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1843216535:82 , srv273682298:82 , srv584312721:82 , srv1108120975:83 , srv1259398504:83 , srv1537742216:83 , srv1965255835:83 , srv1006100417:84 , srv1007205619:84 , srv1357739161:84 , srv1434853091:84 , srv154188338:84 , srv1808468065:84 , srv1867021617:84 , srv188084989:84 , srv2100527132:84 , srv212481424:84 , srv2143539415:84 , srv455283470:84 , srv600681751:84 , srv622403885:84 , srv731485073:84 , srv75895080:84 , srv770702461:84 , srv809356411:84 , srv927827336:84 , srv948699970:84 , srv1100578152:85 , srv1100738684:85 , srv1218844899:85 , srv1275595776:85 , srv1400133203:85 , srv1606417328:85 , srv1711982919:85 , srv1855469680:85 , srv192169762:85 , srv1932089865:85 , srv1937534931:85 , srv1960526093:85 , srv2113901:85 , srv22640933:85 , srv233637046:85 , srv293971880:85 , srv31779750:85 , srv338110395:85 , srv355633008:85 , srv652554495:85 , srv697008470:85 , srv764226702:85 , srv946774078:85 , srv1141539817:86 , srv1195517892:86 , srv1231871076:86 , srv1286894694:86 , srv1330133332:86 , srv145018672:86 , srv1600668595:86 , srv1684894545:86 , srv1801099798:86 , srv1963044698:86 , srv2080261220:86 , srv2115415184:86 , srv461735432:86 , srv650288736:86 , srv661133572:86 , srv744963736:86 , srv794375301:86 , srv820831029:86 , srv863300102:86 , srv934083959:86 , srv939679933:86 , srv1092324358:87 , srv1245078838:87 , srv1250347432:87 , srv1310361266:87 , srv1442084339:87 , srv1569124822:87 , srv1684606391:87 , srv1813655576:87 , srv1904110323:87 , srv2028713905:87 , srv350400946:87 , srv609805100:87 , srv61270348:87 , srv706351619:87 , srv755132809:87 , srv902520409:87 , srv917064239:87 , srv1418307540:88 , srv1419444489:88 , srv1718798160:88 , srv355401120:88 , srv673491423:88 , srv756168847:88 , srv1272132461:89 , srv1504327691:89 , srv509691508:89 , srv88856628:89 , srv965767291:90 , srv242719301:528 }
2023-12-23 15:56:12,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-23 15:56:12,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv145018672=24, srv61270348=72, srv1250347432=11, srv154188338=27, srv461735432=67, srv1711982919=33, srv31779750=61, srv1504327691=25, srv293971880=60, srv744963736=81, srv706351619=79, srv820831029=89, srv1218844899=8, srv192169762=43, srv1904110323=42, srv22640933=56, srv2143539415=55, srv1100738684=4, srv1286894694=15, srv1400133203=19, srv1434853091=22, srv934083959=95, srv188084989=41, srv863300102=90, srv1684894545=32, srv1718798160=34, srv1100578152=3, srv1606417328=30, srv2115415184=53, srv731485073=80, srv1108120975=5, srv1813655576=37, srv1272132461=13, srv1245078838=10, srv756168847=83, srv1537742216=26, srv1801099798=35, srv1932089865=44, srv584312721=69, srv794375301=87, srv2113901=52, srv1330133332=17, srv609805100=71, srv755132809=82, srv1808468065=36, srv509691508=68, srv88856628=91, srv770702461=86, srv650288736=74, srv1937534931=45, srv1195517892=7, srv350400946=63, srv946774078=97, srv1963044698=47, srv1418307540=20, srv355633008=65, srv1684606391=31, srv1867021617=40, srv212481424=54, srv917064239=93, srv273682298=59, srv927827336=94, srv233637046=57, srv355401120=64, srv661133572=76, srv75895080=84, srv338110395=62, srv600681751=70, srv764226702=85, srv1141539817=6, srv673491423=77, srv1600668595=29, srv2028713905=49, srv2080261220=50, srv1569124822=28, srv1231871076=9, srv1843216535=38, srv622403885=73, srv1442084339=23, srv1960526093=46, srv1092324358=2, srv242719301=58, srv697008470=78, srv652554495=75, srv1357739161=18, srv1006100417=0, srv1965255835=48, srv2100527132=51, srv455283470=66, srv1310361266=16, srv1855469680=39, srv809356411=88, srv1259398504=12, srv948699970=98, srv1275595776=14, srv1007205619=1, srv965767291=99, srv1419444489=21, srv939679933=96, srv902520409=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-23 15:56:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-23 15:56:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-23 15:56:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-23 15:56:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-23 15:56:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-23 15:56:12,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-23 15:56:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-23 15:56:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-23 15:56:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-23 15:56:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-23 15:56:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-23 15:56:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-23 15:56:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-23 15:56:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-23 15:56:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-23 15:56:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-23 15:56:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-23 15:56:12,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-23 15:56:12,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-23 15:56:12,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-23 15:56:12,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-23 15:56:12,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-23 15:56:12,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-23 15:56:12,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-23 15:56:12,728 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005866707478686735); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008619660142094213); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005866707478686735); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:56:12,728 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-23 15:56:12,728 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.022829680204829E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005866707478686735); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008619660142094213); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005866707478686735); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-23 15:56:13,220 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 575 ms to try 5000 different iterations.  Found a solution that moves 275 regions; Going from a computed imbalance of 8.022829680204829E-4 to a new imbalance of 3.113405650400159E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00259499648053841); MoveCostFunction : (multiplier=7.0, imbalance=0.030555555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:56:13,222 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1434853091:83 , srv1843216535:83 , srv673491423:83 , srv706351619:83 , srv755132809:83 , srv946774078:83 , srv1007205619:84 , srv1092324358:84 , srv1100578152:84 , srv1100738684:84 , srv1141539817:84 , srv1231871076:84 , srv1245078838:84 , srv1250347432:84 , srv1259398504:84 , srv1272132461:84 , srv1275595776:84 , srv1286894694:84 , srv1330133332:84 , srv1400133203:84 , srv1442084339:84 , srv145018672:84 , srv1504327691:84 , srv154188338:84 , srv1569124822:84 , srv1600668595:84 , srv1813655576:84 , srv188084989:84 , srv1904110323:84 , srv1932089865:84 , srv1937534931:84 , srv2100527132:84 , srv212481424:84 , srv22640933:84 , srv233637046:84 , srv31779750:84 , srv338110395:84 , srv509691508:84 , srv600681751:84 , srv609805100:84 , srv661133572:84 , srv697008470:84 , srv744963736:84 , srv820831029:84 , srv88856628:84 , srv917064239:84 , srv965767291:84 , srv1006100417:85 , srv1108120975:85 , srv1195517892:85 , srv1218844899:85 , srv1310361266:85 , srv1418307540:85 , srv1537742216:85 , srv1606417328:85 , srv1684606391:85 , srv1684894545:85 , srv1711982919:85 , srv1718798160:85 , srv1801099798:85 , srv1808468065:85 , srv1855469680:85 , srv1867021617:85 , srv192169762:85 , srv1960526093:85 , srv1963044698:85 , srv1965255835:85 , srv2028713905:85 , srv2080261220:85 , srv2115415184:85 , srv273682298:85 , srv293971880:85 , srv350400946:85 , srv355401120:85 , srv355633008:85 , srv455283470:85 , srv461735432:85 , srv584312721:85 , srv650288736:85 , srv652554495:85 , srv731485073:85 , srv756168847:85 , srv75895080:85 , srv764226702:85 , srv770702461:85 , srv794375301:85 , srv809356411:85 , srv863300102:85 , srv902520409:85 , srv927827336:85 , srv934083959:85 , srv939679933:85 , srv948699970:85 , srv1357739161:86 , srv1419444489:86 , srv2113901:86 , srv2143539415:86 , srv61270348:86 , srv622403885:86 , srv242719301:632 }
2023-12-23 15:56:13,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-23 15:56:13,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv145018672=24, srv61270348=72, srv1250347432=11, srv154188338=27, srv461735432=67, srv1711982919=33, srv31779750=61, srv1504327691=25, srv293971880=60, srv744963736=81, srv706351619=79, srv820831029=89, srv1218844899=8, srv192169762=43, srv1904110323=42, srv22640933=56, srv2143539415=55, srv1100738684=4, srv1286894694=15, srv1400133203=19, srv1434853091=22, srv934083959=95, srv188084989=41, srv863300102=90, srv1684894545=32, srv1718798160=34, srv1100578152=3, srv1606417328=30, srv2115415184=53, srv731485073=80, srv1108120975=5, srv1813655576=37, srv1272132461=13, srv1245078838=10, srv756168847=83, srv1537742216=26, srv1801099798=35, srv1932089865=44, srv584312721=69, srv794375301=87, srv2113901=52, srv1330133332=17, srv609805100=71, srv755132809=82, srv1808468065=36, srv509691508=68, srv88856628=91, srv770702461=86, srv650288736=74, srv1937534931=45, srv1195517892=7, srv350400946=63, srv946774078=97, srv1963044698=47, srv1418307540=20, srv355633008=65, srv1684606391=31, srv1867021617=40, srv212481424=54, srv917064239=93, srv273682298=59, srv927827336=94, srv233637046=57, srv355401120=64, srv661133572=76, srv75895080=84, srv338110395=62, srv600681751=70, srv764226702=85, srv1141539817=6, srv673491423=77, srv1600668595=29, srv2028713905=49, srv2080261220=50, srv1569124822=28, srv1231871076=9, srv1843216535=38, srv622403885=73, srv1442084339=23, srv1960526093=46, srv1092324358=2, srv242719301=58, srv697008470=78, srv652554495=75, srv1357739161=18, srv1006100417=0, srv1965255835=48, srv2100527132=51, srv455283470=66, srv1310361266=16, srv1855469680=39, srv809356411=88, srv1259398504=12, srv948699970=98, srv1275595776=14, srv1007205619=1, srv965767291=99, srv1419444489=21, srv939679933=96, srv902520409=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-23 15:56:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-23 15:56:13,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-23 15:56:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-23 15:56:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-23 15:56:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-23 15:56:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-23 15:56:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-23 15:56:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-23 15:56:13,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-23 15:56:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-23 15:56:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-23 15:56:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-23 15:56:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-23 15:56:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-23 15:56:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-23 15:56:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-23 15:56:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-23 15:56:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-23 15:56:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-23 15:56:13,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-23 15:56:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-23 15:56:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-23 15:56:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-23 15:56:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-23 15:56:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-23 15:56:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-23 15:56:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-23 15:56:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-23 15:56:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-23 15:56:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-23 15:56:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-23 15:56:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-23 15:56:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-23 15:56:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-23 15:56:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-23 15:56:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-23 15:56:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-23 15:56:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-23 15:56:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-23 15:56:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-23 15:56:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-23 15:56:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-23 15:56:13,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-23 15:56:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-23 15:56:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-23 15:56:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-23 15:56:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-23 15:56:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-23 15:56:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-23 15:56:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-23 15:56:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-23 15:56:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-23 15:56:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-23 15:56:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-23 15:56:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-23 15:56:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-23 15:56:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-23 15:56:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-23 15:56:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-23 15:56:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-23 15:56:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-23 15:56:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-23 15:56:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-23 15:56:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-23 15:56:13,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-23 15:56:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-23 15:56:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-23 15:56:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-23 15:56:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-23 15:56:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-23 15:56:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-23 15:56:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-23 15:56:13,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-23 15:56:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-23 15:56:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-23 15:56:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-23 15:56:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-23 15:56:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-23 15:56:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-23 15:56:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-23 15:56:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-23 15:56:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-23 15:56:13,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-23 15:56:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-23 15:56:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-23 15:56:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-23 15:56:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-23 15:56:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-23 15:56:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-23 15:56:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-23 15:56:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-23 15:56:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-23 15:56:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-23 15:56:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-23 15:56:13,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-23 15:56:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-23 15:56:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-23 15:56:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-23 15:56:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-23 15:56:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-23 15:56:13,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-23 15:56:13,464 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00259499648053841); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:56:13,464 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-23 15:56:13,465 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.9208465347516552E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00259499648053841); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-23 15:56:14,127 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 795 ms to try 5000 different iterations.  Found a solution that moves 43 regions; Going from a computed imbalance of 2.9208465347516552E-5 to a new imbalance of 7.374331731707109E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0047777777777777775); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:56:14,127 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1195517892:83 , srv1357739161:83 , srv1419444489:83 , srv1813655576:83 , srv2113901:83 , srv2115415184:83 , srv2143539415:83 , srv355633008:83 , srv61270348:83 , srv622403885:83 , srv75895080:83 , srv1006100417:84 , srv1007205619:84 , srv1092324358:84 , srv1100578152:84 , srv1100738684:84 , srv1108120975:84 , srv1218844899:84 , srv1231871076:84 , srv1245078838:84 , srv1259398504:84 , srv1272132461:84 , srv1286894694:84 , srv1310361266:84 , srv1330133332:84 , srv1400133203:84 , srv1418307540:84 , srv1442084339:84 , srv145018672:84 , srv1504327691:84 , srv1537742216:84 , srv154188338:84 , srv1569124822:84 , srv1600668595:84 , srv1606417328:84 , srv1684606391:84 , srv1684894545:84 , srv1711982919:84 , srv1718798160:84 , srv1801099798:84 , srv1808468065:84 , srv1855469680:84 , srv1867021617:84 , srv188084989:84 , srv1904110323:84 , srv192169762:84 , srv1932089865:84 , srv1937534931:84 , srv1960526093:84 , srv1963044698:84 , srv1965255835:84 , srv2028713905:84 , srv2080261220:84 , srv2100527132:84 , srv22640933:84 , srv233637046:84 , srv273682298:84 , srv293971880:84 , srv31779750:84 , srv338110395:84 , srv350400946:84 , srv355401120:84 , srv455283470:84 , srv461735432:84 , srv509691508:84 , srv584312721:84 , srv600681751:84 , srv609805100:84 , srv650288736:84 , srv652554495:84 , srv661133572:84 , srv673491423:84 , srv731485073:84 , srv744963736:84 , srv756168847:84 , srv764226702:84 , srv770702461:84 , srv794375301:84 , srv809356411:84 , srv863300102:84 , srv88856628:84 , srv902520409:84 , srv917064239:84 , srv927827336:84 , srv934083959:84 , srv939679933:84 , srv948699970:84 , srv965767291:84 , srv1141539817:85 , srv1250347432:85 , srv1275595776:85 , srv1434853091:85 , srv1843216535:85 , srv212481424:85 , srv697008470:85 , srv706351619:85 , srv755132809:85 , srv820831029:85 , srv946774078:85 , srv242719301:684 }
2023-12-23 15:56:14,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-23 15:56:14,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv145018672=24, srv61270348=72, srv1250347432=11, srv154188338=27, srv461735432=67, srv1711982919=33, srv31779750=61, srv1504327691=25, srv293971880=60, srv744963736=81, srv706351619=79, srv820831029=89, srv1218844899=8, srv192169762=43, srv1904110323=42, srv22640933=56, srv2143539415=55, srv1100738684=4, srv1286894694=15, srv1400133203=19, srv1434853091=22, srv934083959=95, srv188084989=41, srv863300102=90, srv1684894545=32, srv1718798160=34, srv1100578152=3, srv1606417328=30, srv2115415184=53, srv731485073=80, srv1108120975=5, srv1813655576=37, srv1272132461=13, srv1245078838=10, srv756168847=83, srv1537742216=26, srv1801099798=35, srv1932089865=44, srv584312721=69, srv794375301=87, srv2113901=52, srv1330133332=17, srv609805100=71, srv755132809=82, srv1808468065=36, srv509691508=68, srv88856628=91, srv770702461=86, srv650288736=74, srv1937534931=45, srv1195517892=7, srv350400946=63, srv946774078=97, srv1963044698=47, srv1418307540=20, srv355633008=65, srv1684606391=31, srv1867021617=40, srv212481424=54, srv917064239=93, srv273682298=59, srv927827336=94, srv233637046=57, srv355401120=64, srv661133572=76, srv75895080=84, srv338110395=62, srv600681751=70, srv764226702=85, srv1141539817=6, srv673491423=77, srv1600668595=29, srv2028713905=49, srv2080261220=50, srv1569124822=28, srv1231871076=9, srv1843216535=38, srv622403885=73, srv1442084339=23, srv1960526093=46, srv1092324358=2, srv242719301=58, srv697008470=78, srv652554495=75, srv1357739161=18, srv1006100417=0, srv1965255835=48, srv2100527132=51, srv455283470=66, srv1310361266=16, srv1855469680=39, srv809356411=88, srv1259398504=12, srv948699970=98, srv1275595776=14, srv1007205619=1, srv965767291=99, srv1419444489=21, srv939679933=96, srv902520409=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-23 15:56:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-23 15:56:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-23 15:56:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-23 15:56:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-23 15:56:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-23 15:56:14,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-23 15:56:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-23 15:56:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-23 15:56:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-23 15:56:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-23 15:56:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-23 15:56:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-23 15:56:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-23 15:56:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-23 15:56:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-23 15:56:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-23 15:56:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-23 15:56:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-23 15:56:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-23 15:56:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-23 15:56:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-23 15:56:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-23 15:56:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-23 15:56:14,238 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:56:14,239 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1195517892:83 , srv1357739161:83 , srv1419444489:83 , srv1813655576:83 , srv2113901:83 , srv2115415184:83 , srv2143539415:83 , srv355633008:83 , srv61270348:83 , srv622403885:83 , srv75895080:83 , srv1006100417:84 , srv1007205619:84 , srv1092324358:84 , srv1100578152:84 , srv1100738684:84 , srv1108120975:84 , srv1218844899:84 , srv1231871076:84 , srv1245078838:84 , srv1259398504:84 , srv1272132461:84 , srv1286894694:84 , srv1310361266:84 , srv1330133332:84 , srv1400133203:84 , srv1418307540:84 , srv1442084339:84 , srv145018672:84 , srv1504327691:84 , srv1537742216:84 , srv154188338:84 , srv1569124822:84 , srv1600668595:84 , srv1606417328:84 , srv1684606391:84 , srv1684894545:84 , srv1711982919:84 , srv1718798160:84 , srv1801099798:84 , srv1808468065:84 , srv1855469680:84 , srv1867021617:84 , srv188084989:84 , srv1904110323:84 , srv192169762:84 , srv1932089865:84 , srv1937534931:84 , srv1960526093:84 , srv1963044698:84 , srv1965255835:84 , srv2028713905:84 , srv2080261220:84 , srv2100527132:84 , srv22640933:84 , srv233637046:84 , srv273682298:84 , srv293971880:84 , srv31779750:84 , srv338110395:84 , srv350400946:84 , srv355401120:84 , srv455283470:84 , srv461735432:84 , srv509691508:84 , srv584312721:84 , srv600681751:84 , srv609805100:84 , srv650288736:84 , srv652554495:84 , srv661133572:84 , srv673491423:84 , srv731485073:84 , srv744963736:84 , srv756168847:84 , srv764226702:84 , srv770702461:84 , srv794375301:84 , srv809356411:84 , srv863300102:84 , srv88856628:84 , srv902520409:84 , srv917064239:84 , srv927827336:84 , srv934083959:84 , srv939679933:84 , srv948699970:84 , srv965767291:84 , srv1141539817:85 , srv1250347432:85 , srv1275595776:85 , srv1434853091:85 , srv1843216535:85 , srv212481424:85 , srv697008470:85 , srv706351619:85 , srv755132809:85 , srv820831029:85 , srv946774078:85 , srv242719301:684 }
2023-12-23 15:56:14,259 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=128 (was 128), ProcessCount=175 (was 175), AvailableMemoryMB=2933 (was 3656)
2023-12-23 15:56:14,266 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=128, ProcessCount=175, AvailableMemoryMB=2933
2023-12-23 15:56:14,266 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-23 15:56:14,266 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-23 15:56:14,273 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1014026024:84 , srv1029447525:84 , srv1083876023:84 , srv1092077052:84 , srv1099116497:84 , srv1251552835:84 , srv1293388168:84 , srv1364529218:84 , srv1391132653:84 , srv1459274730:84 , srv1477344130:84 , srv15287647:84 , srv1586432159:84 , srv1616720262:84 , srv1619111953:84 , srv1855739833:84 , srv1992724261:84 , srv2016439864:84 , srv247387656:84 , srv248079315:84 , srv310977885:84 , srv312953764:84 , srv413571636:84 , srv420106597:84 , srv422284289:84 , srv57923260:84 , srv762998850:84 , srv801507877:84 , srv844057625:84 , srv794539751:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-23 15:56:14,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-23 15:56:14,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv312953764=21, srv413571636=22, srv15287647=11, srv1092077052=3, srv247387656=18, srv1459274730=9, srv1619111953=14, srv1029447525=1, srv1251552835=5, srv801507877=28, srv1014026024=0, srv1364529218=7, srv1293388168=6, srv1083876023=2, srv1477344130=10, srv1616720262=13, srv248079315=19, srv1099116497=4, srv57923260=25, srv794539751=27, srv2016439864=17, srv1586432159=12, srv1855739833=15, srv844057625=29, srv420106597=23, srv422284289=24, srv1992724261=16, srv762998850=26, srv310977885=20, srv1391132653=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-23 15:56:14,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-23 15:56:14,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-23 15:56:14,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-23 15:56:14,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-23 15:56:14,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-23 15:56:14,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-23 15:56:14,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-23 15:56:14,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-23 15:56:14,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-23 15:56:14,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-23 15:56:14,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-23 15:56:14,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-23 15:56:14,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-23 15:56:14,296 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1409984390835233, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:56:14,296 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912637324741809, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1409984390835233, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-23 15:58:14,285 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9636359 different iterations.  Found a solution that moves 1833 regions; Going from a computed imbalance of 0.9912637324741809 to a new imbalance of 4.278313442226764E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6788888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:58:14,290 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1014026024:90 , srv1029447525:90 , srv1083876023:90 , srv1092077052:90 , srv1099116497:90 , srv1251552835:90 , srv1293388168:90 , srv1364529218:90 , srv1391132653:90 , srv1459274730:90 , srv1477344130:90 , srv15287647:90 , srv1586432159:90 , srv1616720262:90 , srv1619111953:90 , srv1855739833:90 , srv1992724261:90 , srv2016439864:90 , srv247387656:90 , srv248079315:90 , srv310977885:90 , srv312953764:90 , srv413571636:90 , srv420106597:90 , srv422284289:90 , srv57923260:90 , srv762998850:90 , srv794539751:90 , srv801507877:90 , srv844057625:90 }
2023-12-23 15:58:14,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-23 15:58:14,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv312953764=21, srv413571636=22, srv15287647=11, srv1092077052=3, srv247387656=18, srv1459274730=9, srv1619111953=14, srv1029447525=1, srv1251552835=5, srv801507877=28, srv1014026024=0, srv1364529218=7, srv1293388168=6, srv1083876023=2, srv1477344130=10, srv1616720262=13, srv248079315=19, srv1099116497=4, srv57923260=25, srv794539751=27, srv2016439864=17, srv1586432159=12, srv1855739833=15, srv844057625=29, srv420106597=23, srv422284289=24, srv1992724261=16, srv762998850=26, srv310977885=20, srv1391132653=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-23 15:58:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-23 15:58:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-23 15:58:14,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-23 15:58:14,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-23 15:58:14,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-23 15:58:14,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-23 15:58:14,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-23 15:58:14,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-23 15:58:14,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-23 15:58:14,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-23 15:58:14,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-23 15:58:14,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-23 15:58:14,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-23 15:58:14,305 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-23 15:58:14,305 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1014026024:90 , srv1029447525:90 , srv1083876023:90 , srv1092077052:90 , srv1099116497:90 , srv1251552835:90 , srv1293388168:90 , srv1364529218:90 , srv1391132653:90 , srv1459274730:90 , srv1477344130:90 , srv15287647:90 , srv1586432159:90 , srv1616720262:90 , srv1619111953:90 , srv1855739833:90 , srv1992724261:90 , srv2016439864:90 , srv247387656:90 , srv248079315:90 , srv310977885:90 , srv312953764:90 , srv413571636:90 , srv420106597:90 , srv422284289:90 , srv57923260:90 , srv762998850:90 , srv794539751:90 , srv801507877:90 , srv844057625:90 }
2023-12-23 15:58:14,317 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=139 (was 128) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 175), AvailableMemoryMB=4673 (was 2933) - AvailableMemoryMB LEAK? -