2023-10-16 14:53:28,823 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-16 14:53:29,131 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-16 14:53:29,246 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-16 14:53:29,306 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-16 14:53:29,314 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-16 14:53:29,327 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=369, ProcessCount=169, AvailableMemoryMB=5337
2023-10-16 14:53:29,329 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-16 14:53:29,329 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-16 14:53:29,460 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1014505571:84 , srv1026792101:84 , srv1056090899:84 , srv1074375515:84 , srv1082233162:84 , srv108896983:84 , srv1203719740:84 , srv1243163383:84 , srv1244667675:84 , srv1254432261:84 , srv1296100568:84 , srv1297146282:84 , srv1332920271:84 , srv1388524455:84 , srv1410402642:84 , srv1444677531:84 , srv1457423726:84 , srv1500800810:84 , srv1506301047:84 , srv1534272759:84 , srv1553741991:84 , srv1595418461:84 , srv1599474787:84 , srv1635625230:84 , srv1658530229:84 , srv1687652156:84 , srv1696784399:84 , srv1707691964:84 , srv1711621637:84 , srv172523516:84 , srv1725724158:84 , srv1730509612:84 , srv1746841180:84 , srv1760245412:84 , srv1765573850:84 , srv1771425587:84 , srv1776437476:84 , srv1786301088:84 , srv1805860854:84 , srv1816357727:84 , srv1857197652:84 , srv1874391278:84 , srv188099575:84 , srv1906865849:84 , srv1957151759:84 , srv1970388602:84 , srv2034926644:84 , srv2054256975:84 , srv2060060046:84 , srv2072341239:84 , srv2080318807:84 , srv2113446162:84 , srv2113995425:84 , srv229741783:84 , srv236037710:84 , srv268349111:84 , srv27718665:84 , srv301452705:84 , srv304752276:84 , srv34612551:84 , srv396926723:84 , srv415855941:84 , srv42333071:84 , srv428985666:84 , srv459562527:84 , srv471245252:84 , srv488118145:84 , srv510988442:84 , srv519579449:84 , srv545891998:84 , srv57459637:84 , srv605150982:84 , srv605286216:84 , srv617669874:84 , srv65885360:84 , srv688383480:84 , srv691314394:84 , srv719993364:84 , srv723545679:84 , srv767242899:84 , srv778694182:84 , srv783284489:84 , srv78620003:84 , srv791871435:84 , srv795720528:84 , srv8087327:84 , srv861362549:84 , srv86146228:84 , srv871094775:84 , srv881189858:84 , srv891454926:84 , srv907093233:84 , srv934667668:84 , srv938140203:84 , srv946903974:84 , srv962042754:84 , srv962758996:84 , srv97671276:84 , srv980150633:84 , srv1313364607:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-16 14:53:29,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-16 14:53:29,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1296100568=10, srv2060060046=49, srv1074375515=3, srv2113995425=53, srv1244667675=8, srv795720528=85, srv1658530229=25, srv1026792101=1, srv488118145=67, srv2080318807=51, srv396926723=61, srv767242899=80, srv1500800810=18, srv2113446162=52, srv605150982=72, srv1857197652=41, srv8087327=86, srv2054256975=48, srv301452705=58, srv1730509612=32, srv97671276=98, srv519579449=69, srv1816357727=40, srv108896983=5, srv1906865849=44, srv78620003=83, srv1696784399=27, srv459562527=65, srv1254432261=9, srv415855941=62, srv1410402642=15, srv791871435=84, srv938140203=94, srv1332920271=13, srv1388524455=14, srv1874391278=42, srv783284489=82, srv723545679=79, srv510988442=68, srv946903974=95, srv34612551=60, srv617669874=74, srv86146228=88, srv545891998=70, srv1056090899=2, srv1707691964=28, srv1243163383=7, srv1203719740=6, srv1746841180=33, srv1506301047=19, srv27718665=57, srv962758996=97, srv57459637=71, srv719993364=78, srv962042754=96, srv428985666=64, srv1957151759=45, srv881189858=90, srv861362549=87, srv691314394=77, srv1082233162=4, srv1599474787=23, srv1014505571=0, srv1457423726=17, srv1805860854=39, srv2034926644=47, srv871094775=89, srv891454926=91, srv471245252=66, srv65885360=75, srv1786301088=38, srv1970388602=46, srv1297146282=11, srv1687652156=26, srv188099575=43, srv268349111=56, srv1313364607=12, srv1534272759=20, srv1444677531=16, srv229741783=54, srv1776437476=37, srv1711621637=29, srv1760245412=34, srv1635625230=24, srv42333071=63, srv1595418461=22, srv2072341239=50, srv236037710=55, srv605286216=73, srv688383480=76, srv172523516=30, srv1765573850=35, srv980150633=99, srv1725724158=31, srv304752276=59, srv778694182=81, srv1553741991=21, srv934667668=93, srv1771425587=36, srv907093233=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-16 14:53:29,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-16 14:53:29,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-16 14:53:29,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-16 14:53:29,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-16 14:53:29,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-16 14:53:29,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-16 14:53:29,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-16 14:53:29,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-16 14:53:29,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-16 14:53:29,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-16 14:53:29,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-16 14:53:29,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-16 14:53:29,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-16 14:53:29,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-16 14:53:29,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-16 14:53:29,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-16 14:53:29,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-16 14:53:29,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-16 14:53:29,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-16 14:53:29,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-16 14:53:29,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-16 14:53:29,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-16 14:53:29,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-16 14:53:29,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-16 14:53:29,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-16 14:53:29,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-16 14:53:29,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-16 14:53:29,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-16 14:53:29,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-16 14:53:29,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-16 14:53:29,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-16 14:53:29,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-16 14:53:29,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-16 14:53:29,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-16 14:53:29,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-16 14:53:29,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-16 14:53:29,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-16 14:53:29,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-16 14:53:29,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-16 14:53:29,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-16 14:53:29,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-16 14:53:29,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-16 14:53:29,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-16 14:53:29,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-16 14:53:29,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-16 14:53:29,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-16 14:53:29,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-16 14:53:29,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-16 14:53:29,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-16 14:53:29,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-16 14:53:29,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-16 14:53:29,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-16 14:53:29,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-16 14:53:29,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-16 14:53:29,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-16 14:53:29,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-16 14:53:29,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-16 14:53:29,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-16 14:53:29,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-16 14:53:29,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-16 14:53:29,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-16 14:53:29,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-16 14:53:29,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-16 14:53:29,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-16 14:53:29,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-16 14:53:29,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-16 14:53:29,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-16 14:53:29,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-16 14:53:29,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-16 14:53:29,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-16 14:53:29,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-16 14:53:29,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-16 14:53:29,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-16 14:53:29,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-16 14:53:29,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-16 14:53:29,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-16 14:53:29,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-16 14:53:29,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-16 14:53:29,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-16 14:53:29,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-16 14:53:29,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-16 14:53:29,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-16 14:53:29,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-16 14:53:29,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-16 14:53:29,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-16 14:53:29,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-16 14:53:29,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-16 14:53:29,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-16 14:53:29,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-16 14:53:29,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-16 14:53:29,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-16 14:53:29,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-16 14:53:29,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-16 14:53:29,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-16 14:53:29,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-16 14:53:29,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-16 14:53:29,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-16 14:53:29,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-16 14:53:29,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-16 14:53:29,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-16 14:53:29,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-16 14:53:29,957 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-16 14:53:29,957 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-16 14:53:29,957 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-16 14:53:30,763 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1158 ms to try 5000 different iterations.  Found a solution that moves 4708 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.180093515423205. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038488073956582866, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05498903063757495, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5231111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038488073956582866, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17583333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23691666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-16 14:53:30,776 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2054256975:80 , srv304752276:81 , srv778694182:81 , srv1776437476:82 , srv1074375515:83 , srv1203719740:83 , srv1506301047:83 , srv1687652156:83 , srv1711621637:83 , srv172523516:83 , srv1725724158:83 , srv1730509612:83 , srv188099575:83 , srv236037710:83 , srv545891998:83 , srv617669874:83 , srv1500800810:84 , srv1707691964:84 , srv8087327:84 , srv891454926:84 , srv1082233162:85 , srv1696784399:85 , srv1805860854:85 , srv2034926644:85 , srv27718665:85 , srv34612551:85 , srv519579449:85 , srv605286216:85 , srv65885360:85 , srv688383480:85 , srv86146228:85 , srv1026792101:86 , srv108896983:86 , srv1244667675:86 , srv1254432261:86 , srv1457423726:86 , srv1595418461:86 , srv1635625230:86 , srv1857197652:86 , srv1874391278:86 , srv2113995425:86 , srv415855941:86 , srv767242899:86 , srv795720528:86 , srv871094775:86 , srv980150633:86 , srv1056090899:87 , srv1243163383:87 , srv1332920271:87 , srv1388524455:87 , srv1444677531:87 , srv1746841180:87 , srv1760245412:87 , srv2072341239:87 , srv488118145:87 , srv605150982:87 , srv719993364:87 , srv907093233:87 , srv962042754:87 , srv97671276:87 , srv1014505571:88 , srv1297146282:88 , srv1410402642:88 , srv1658530229:88 , srv1816357727:88 , srv1906865849:88 , srv2113446162:88 , srv229741783:88 , srv268349111:88 , srv301452705:88 , srv42333071:88 , srv459562527:88 , srv57459637:88 , srv691314394:88 , srv723545679:88 , srv861362549:88 , srv934667668:88 , srv938140203:88 , srv946903974:88 , srv962758996:88 , srv1534272759:89 , srv1599474787:89 , srv1765573850:89 , srv1771425587:89 , srv1786301088:89 , srv2060060046:89 , srv2080318807:89 , srv428985666:89 , srv471245252:89 , srv510988442:89 , srv78620003:89 , srv791871435:89 , srv1553741991:90 , srv1957151759:90 , srv396926723:90 , srv783284489:92 , srv881189858:92 , srv1970388602:93 , srv1296100568:94 , srv1313364607:432 }
2023-10-16 14:53:30,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-16 14:53:30,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1296100568=10, srv2060060046=49, srv1074375515=3, srv2113995425=53, srv1244667675=8, srv795720528=85, srv1658530229=25, srv1026792101=1, srv488118145=67, srv2080318807=51, srv396926723=61, srv767242899=80, srv1500800810=18, srv2113446162=52, srv605150982=72, srv1857197652=41, srv8087327=86, srv2054256975=48, srv301452705=58, srv1730509612=32, srv97671276=98, srv519579449=69, srv1816357727=40, srv108896983=5, srv1906865849=44, srv78620003=83, srv1696784399=27, srv459562527=65, srv1254432261=9, srv415855941=62, srv1410402642=15, srv791871435=84, srv938140203=94, srv1332920271=13, srv1388524455=14, srv1874391278=42, srv783284489=82, srv723545679=79, srv510988442=68, srv946903974=95, srv34612551=60, srv617669874=74, srv86146228=88, srv545891998=70, srv1056090899=2, srv1707691964=28, srv1243163383=7, srv1203719740=6, srv1746841180=33, srv1506301047=19, srv27718665=57, srv962758996=97, srv57459637=71, srv719993364=78, srv962042754=96, srv428985666=64, srv1957151759=45, srv881189858=90, srv861362549=87, srv691314394=77, srv1082233162=4, srv1599474787=23, srv1014505571=0, srv1457423726=17, srv1805860854=39, srv2034926644=47, srv871094775=89, srv891454926=91, srv471245252=66, srv65885360=75, srv1786301088=38, srv1970388602=46, srv1297146282=11, srv1687652156=26, srv188099575=43, srv268349111=56, srv1313364607=12, srv1534272759=20, srv1444677531=16, srv229741783=54, srv1776437476=37, srv1711621637=29, srv1760245412=34, srv1635625230=24, srv42333071=63, srv1595418461=22, srv2072341239=50, srv236037710=55, srv605286216=73, srv688383480=76, srv172523516=30, srv1765573850=35, srv980150633=99, srv1725724158=31, srv304752276=59, srv778694182=81, srv1553741991=21, srv934667668=93, srv1771425587=36, srv907093233=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-16 14:53:30,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-16 14:53:30,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-16 14:53:30,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-16 14:53:30,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-16 14:53:30,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-16 14:53:30,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-16 14:53:30,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-16 14:53:30,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-16 14:53:30,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-16 14:53:30,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-16 14:53:30,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-16 14:53:30,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-16 14:53:30,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-16 14:53:30,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-16 14:53:30,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-16 14:53:30,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-16 14:53:30,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-16 14:53:30,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-16 14:53:30,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-16 14:53:30,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-16 14:53:30,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-16 14:53:30,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-16 14:53:30,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-16 14:53:30,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-16 14:53:30,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-16 14:53:30,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-16 14:53:30,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-16 14:53:30,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-16 14:53:30,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-16 14:53:30,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-16 14:53:30,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-16 14:53:30,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-16 14:53:30,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-16 14:53:30,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-16 14:53:30,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-16 14:53:30,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-16 14:53:30,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-16 14:53:30,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-16 14:53:30,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-16 14:53:30,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-16 14:53:30,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-16 14:53:30,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-16 14:53:30,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-16 14:53:30,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-16 14:53:30,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-16 14:53:30,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-16 14:53:30,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-16 14:53:30,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-16 14:53:30,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-16 14:53:30,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-16 14:53:30,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-16 14:53:30,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-16 14:53:30,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-16 14:53:30,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-16 14:53:30,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-16 14:53:30,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-16 14:53:30,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-16 14:53:30,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-16 14:53:30,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-16 14:53:30,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-16 14:53:30,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-16 14:53:30,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-16 14:53:30,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-16 14:53:30,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-16 14:53:30,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-16 14:53:30,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-16 14:53:30,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-16 14:53:30,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-16 14:53:30,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-16 14:53:30,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-16 14:53:30,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-16 14:53:30,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-16 14:53:30,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-16 14:53:30,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-16 14:53:30,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-16 14:53:30,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-16 14:53:30,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-16 14:53:30,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-16 14:53:30,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-16 14:53:30,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-16 14:53:30,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-16 14:53:30,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-16 14:53:30,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-16 14:53:30,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-16 14:53:30,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-16 14:53:30,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-16 14:53:30,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-16 14:53:30,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-16 14:53:30,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-16 14:53:30,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-16 14:53:30,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-16 14:53:30,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-16 14:53:30,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-16 14:53:30,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-16 14:53:30,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-16 14:53:30,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-16 14:53:30,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-16 14:53:30,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-16 14:53:30,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-16 14:53:30,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-16 14:53:30,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-16 14:53:30,978 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038488073956582866, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05498903063757495, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038488073956582866, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17583333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23691666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-16 14:53:30,979 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-16 14:53:30,979 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18006054930260598, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038488073956582866, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05498903063757495, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038488073956582866, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17583333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23691666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-16 14:53:31,265 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 425 ms to try 5000 different iterations.  Found a solution that moves 2625 regions; Going from a computed imbalance of 0.18006054930260598 to a new imbalance of 0.016680770666743405. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022642490573014398); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03572246178658851, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2916666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022642490573014398); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-16 14:53:31,277 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1553741991:79 , srv1296100568:80 , srv1599474787:80 , srv1970388602:80 , srv783284489:80 , srv1297146282:81 , srv1765573850:81 , srv1906865849:81 , srv1014505571:82 , srv1658530229:82 , srv1957151759:82 , srv2113446162:82 , srv396926723:82 , srv459562527:82 , srv791871435:82 , srv861362549:82 , srv881189858:82 , srv1026792101:83 , srv1243163383:83 , srv1771425587:83 , srv1816357727:83 , srv42333071:83 , srv78620003:83 , srv1244667675:84 , srv1410402642:84 , srv1635625230:84 , srv1786301088:84 , srv1874391278:84 , srv2060060046:84 , srv488118145:84 , srv510988442:84 , srv57459637:84 , srv723545679:84 , srv871094775:84 , srv934667668:84 , srv946903974:84 , srv962758996:84 , srv108896983:85 , srv1332920271:85 , srv1444677531:85 , srv1746841180:85 , srv2080318807:85 , srv2113995425:85 , srv268349111:85 , srv415855941:85 , srv428985666:85 , srv471245252:85 , srv605150982:85 , srv688383480:85 , srv691314394:85 , srv767242899:85 , srv795720528:85 , srv86146228:85 , srv907093233:85 , srv938140203:85 , srv1457423726:86 , srv229741783:86 , srv34612551:86 , srv605286216:86 , srv962042754:86 , srv980150633:86 , srv1074375515:87 , srv1082233162:87 , srv1254432261:87 , srv1595418461:87 , srv1696784399:87 , srv1707691964:87 , srv1711621637:87 , srv1730509612:87 , srv188099575:87 , srv2034926644:87 , srv301452705:87 , srv519579449:87 , srv65885360:87 , srv719993364:87 , srv97671276:87 , srv1056090899:88 , srv1203719740:88 , srv1534272759:88 , srv1760245412:88 , srv1776437476:88 , srv2072341239:88 , srv236037710:88 , srv617669874:88 , srv1388524455:89 , srv1506301047:89 , srv1805860854:89 , srv1857197652:89 , srv27718665:89 , srv778694182:89 , srv891454926:89 , srv1725724158:90 , srv304752276:90 , srv545891998:90 , srv8087327:90 , srv1500800810:91 , srv1687652156:91 , srv2054256975:91 , srv172523516:92 , srv1313364607:543 }
2023-10-16 14:53:31,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-16 14:53:31,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1296100568=10, srv2060060046=49, srv1074375515=3, srv2113995425=53, srv1244667675=8, srv795720528=85, srv1658530229=25, srv1026792101=1, srv488118145=67, srv2080318807=51, srv396926723=61, srv767242899=80, srv1500800810=18, srv2113446162=52, srv605150982=72, srv1857197652=41, srv8087327=86, srv2054256975=48, srv301452705=58, srv1730509612=32, srv97671276=98, srv519579449=69, srv1816357727=40, srv108896983=5, srv1906865849=44, srv78620003=83, srv1696784399=27, srv459562527=65, srv1254432261=9, srv415855941=62, srv1410402642=15, srv791871435=84, srv938140203=94, srv1332920271=13, srv1388524455=14, srv1874391278=42, srv783284489=82, srv723545679=79, srv510988442=68, srv946903974=95, srv34612551=60, srv617669874=74, srv86146228=88, srv545891998=70, srv1056090899=2, srv1707691964=28, srv1243163383=7, srv1203719740=6, srv1746841180=33, srv1506301047=19, srv27718665=57, srv962758996=97, srv57459637=71, srv719993364=78, srv962042754=96, srv428985666=64, srv1957151759=45, srv881189858=90, srv861362549=87, srv691314394=77, srv1082233162=4, srv1599474787=23, srv1014505571=0, srv1457423726=17, srv1805860854=39, srv2034926644=47, srv871094775=89, srv891454926=91, srv471245252=66, srv65885360=75, srv1786301088=38, srv1970388602=46, srv1297146282=11, srv1687652156=26, srv188099575=43, srv268349111=56, srv1313364607=12, srv1534272759=20, srv1444677531=16, srv229741783=54, srv1776437476=37, srv1711621637=29, srv1760245412=34, srv1635625230=24, srv42333071=63, srv1595418461=22, srv2072341239=50, srv236037710=55, srv605286216=73, srv688383480=76, srv172523516=30, srv1765573850=35, srv980150633=99, srv1725724158=31, srv304752276=59, srv778694182=81, srv1553741991=21, srv934667668=93, srv1771425587=36, srv907093233=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-16 14:53:31,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-16 14:53:31,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-16 14:53:31,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-16 14:53:31,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-16 14:53:31,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-16 14:53:31,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-16 14:53:31,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-16 14:53:31,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-16 14:53:31,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-16 14:53:31,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-16 14:53:31,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-16 14:53:31,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-16 14:53:31,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-16 14:53:31,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-16 14:53:31,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-16 14:53:31,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-16 14:53:31,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-16 14:53:31,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-16 14:53:31,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-16 14:53:31,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-16 14:53:31,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-16 14:53:31,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-16 14:53:31,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-16 14:53:31,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-16 14:53:31,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-16 14:53:31,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-16 14:53:31,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-16 14:53:31,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-16 14:53:31,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-16 14:53:31,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-16 14:53:31,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-16 14:53:31,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-16 14:53:31,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-16 14:53:31,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-16 14:53:31,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-16 14:53:31,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-16 14:53:31,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-16 14:53:31,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-16 14:53:31,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-16 14:53:31,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-16 14:53:31,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-16 14:53:31,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-16 14:53:31,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-16 14:53:31,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-16 14:53:31,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-16 14:53:31,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-16 14:53:31,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-16 14:53:31,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-16 14:53:31,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-16 14:53:31,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-16 14:53:31,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-16 14:53:31,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-16 14:53:31,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-16 14:53:31,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-16 14:53:31,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-16 14:53:31,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-16 14:53:31,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-16 14:53:31,425 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022642490573014398); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03572246178658851, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022642490573014398); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-16 14:53:31,425 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-16 14:53:31,425 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01666239002388605, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022642490573014398); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03572246178658851, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022642490573014398); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-16 14:53:31,662 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 329 ms to try 5000 different iterations.  Found a solution that moves 1056 regions; Going from a computed imbalance of 0.01666239002388605 to a new imbalance of 6.683489839972969E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007007736269786852); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007668789048930225); MoveCostFunction : (multiplier=7.0, imbalance=0.11733333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007007736269786852); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-16 14:53:31,664 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1534272759:80 , srv1388524455:82 , srv1857197652:82 , srv1056090899:83 , srv1500800810:83 , srv172523516:83 , srv1760245412:83 , srv1805860854:83 , srv2072341239:83 , srv2080318807:83 , srv301452705:83 , srv428985666:83 , srv719993364:83 , srv8087327:83 , srv881189858:83 , srv97671276:83 , srv1296100568:84 , srv1687652156:84 , srv229741783:84 , srv268349111:84 , srv471245252:84 , srv510988442:84 , srv519579449:84 , srv545891998:84 , srv605150982:84 , srv891454926:84 , srv962042754:84 , srv1082233162:85 , srv1203719740:85 , srv1254432261:85 , srv1332920271:85 , srv1444677531:85 , srv1457423726:85 , srv1696784399:85 , srv1725724158:85 , srv1786301088:85 , srv1970388602:85 , srv2034926644:85 , srv2054256975:85 , srv2060060046:85 , srv27718665:85 , srv34612551:85 , srv396926723:85 , srv691314394:85 , srv78620003:85 , srv907093233:85 , srv938140203:85 , srv1074375515:86 , srv108896983:86 , srv1244667675:86 , srv1410402642:86 , srv1506301047:86 , srv1595418461:86 , srv1707691964:86 , srv1746841180:86 , srv1771425587:86 , srv1816357727:86 , srv188099575:86 , srv1957151759:86 , srv304752276:86 , srv415855941:86 , srv488118145:86 , srv57459637:86 , srv605286216:86 , srv617669874:86 , srv65885360:86 , srv767242899:86 , srv783284489:86 , srv791871435:86 , srv934667668:86 , srv962758996:86 , srv980150633:86 , srv1014505571:87 , srv1243163383:87 , srv1297146282:87 , srv1635625230:87 , srv1711621637:87 , srv1730509612:87 , srv1765573850:87 , srv1776437476:87 , srv2113446162:87 , srv2113995425:87 , srv236037710:87 , srv42333071:87 , srv459562527:87 , srv688383480:87 , srv778694182:87 , srv795720528:87 , srv861362549:87 , srv86146228:87 , srv946903974:87 , srv1026792101:88 , srv1553741991:88 , srv1599474787:88 , srv1658530229:88 , srv1874391278:88 , srv1906865849:88 , srv723545679:88 , srv871094775:89 , srv1313364607:545 }
2023-10-16 14:53:31,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-16 14:53:31,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1296100568=10, srv2060060046=49, srv1074375515=3, srv2113995425=53, srv1244667675=8, srv795720528=85, srv1658530229=25, srv1026792101=1, srv488118145=67, srv2080318807=51, srv396926723=61, srv767242899=80, srv1500800810=18, srv2113446162=52, srv605150982=72, srv1857197652=41, srv8087327=86, srv2054256975=48, srv301452705=58, srv1730509612=32, srv97671276=98, srv519579449=69, srv1816357727=40, srv108896983=5, srv1906865849=44, srv78620003=83, srv1696784399=27, srv459562527=65, srv1254432261=9, srv415855941=62, srv1410402642=15, srv791871435=84, srv938140203=94, srv1332920271=13, srv1388524455=14, srv1874391278=42, srv783284489=82, srv723545679=79, srv510988442=68, srv946903974=95, srv34612551=60, srv617669874=74, srv86146228=88, srv545891998=70, srv1056090899=2, srv1707691964=28, srv1243163383=7, srv1203719740=6, srv1746841180=33, srv1506301047=19, srv27718665=57, srv962758996=97, srv57459637=71, srv719993364=78, srv962042754=96, srv428985666=64, srv1957151759=45, srv881189858=90, srv861362549=87, srv691314394=77, srv1082233162=4, srv1599474787=23, srv1014505571=0, srv1457423726=17, srv1805860854=39, srv2034926644=47, srv871094775=89, srv891454926=91, srv471245252=66, srv65885360=75, srv1786301088=38, srv1970388602=46, srv1297146282=11, srv1687652156=26, srv188099575=43, srv268349111=56, srv1313364607=12, srv1534272759=20, srv1444677531=16, srv229741783=54, srv1776437476=37, srv1711621637=29, srv1760245412=34, srv1635625230=24, srv42333071=63, srv1595418461=22, srv2072341239=50, srv236037710=55, srv605286216=73, srv688383480=76, srv172523516=30, srv1765573850=35, srv980150633=99, srv1725724158=31, srv304752276=59, srv778694182=81, srv1553741991=21, srv934667668=93, srv1771425587=36, srv907093233=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-16 14:53:31,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-16 14:53:31,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-16 14:53:31,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-16 14:53:31,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-16 14:53:31,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-16 14:53:31,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-16 14:53:31,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-16 14:53:31,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-16 14:53:31,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-16 14:53:31,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-16 14:53:31,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-16 14:53:31,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-16 14:53:31,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-16 14:53:31,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-16 14:53:31,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-16 14:53:31,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-16 14:53:31,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-16 14:53:31,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-16 14:53:31,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-16 14:53:31,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-16 14:53:31,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-16 14:53:31,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-16 14:53:31,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-16 14:53:31,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-16 14:53:31,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-16 14:53:31,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-16 14:53:31,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-16 14:53:31,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-16 14:53:31,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-16 14:53:31,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-16 14:53:31,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-16 14:53:31,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-16 14:53:31,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-16 14:53:31,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-16 14:53:31,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-16 14:53:31,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-16 14:53:31,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-16 14:53:31,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-16 14:53:31,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-16 14:53:31,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-16 14:53:31,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-16 14:53:31,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-16 14:53:31,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-16 14:53:31,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-16 14:53:31,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-16 14:53:31,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-16 14:53:31,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-16 14:53:31,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-16 14:53:31,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-16 14:53:31,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-16 14:53:31,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-16 14:53:31,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-16 14:53:31,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-16 14:53:31,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-16 14:53:31,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-16 14:53:31,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-16 14:53:31,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-16 14:53:31,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-16 14:53:31,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-16 14:53:31,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-16 14:53:31,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-16 14:53:31,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-16 14:53:31,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-16 14:53:31,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-16 14:53:31,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-16 14:53:31,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-16 14:53:31,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-16 14:53:31,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-16 14:53:31,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-16 14:53:31,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-16 14:53:31,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-16 14:53:31,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-16 14:53:31,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-16 14:53:31,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-16 14:53:31,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-16 14:53:31,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-16 14:53:31,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-16 14:53:31,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-16 14:53:31,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-16 14:53:31,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-16 14:53:31,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-16 14:53:31,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-16 14:53:31,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-16 14:53:31,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-16 14:53:31,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-16 14:53:31,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-16 14:53:31,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-16 14:53:31,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-16 14:53:31,802 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007007736269786852); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007668789048930225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007007736269786852); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-16 14:53:31,802 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-16 14:53:31,803 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.609547139563944E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007007736269786852); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007668789048930225); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007007736269786852); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-16 14:53:32,137 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 436 ms to try 5000 different iterations.  Found a solution that moves 288 regions; Going from a computed imbalance of 6.609547139563944E-4 to a new imbalance of 2.018407092434037E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.032, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-16 14:53:32,139 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv723545679:82 , srv1595418461:83 , srv27718665:83 , srv301452705:83 , srv946903974:83 , srv1254432261:84 , srv1332920271:84 , srv1388524455:84 , srv1410402642:84 , srv1457423726:84 , srv1500800810:84 , srv1506301047:84 , srv1635625230:84 , srv1658530229:84 , srv172523516:84 , srv1725724158:84 , srv1746841180:84 , srv1771425587:84 , srv1786301088:84 , srv1874391278:84 , srv1957151759:84 , srv2060060046:84 , srv2072341239:84 , srv2113446162:84 , srv2113995425:84 , srv229741783:84 , srv236037710:84 , srv268349111:84 , srv42333071:84 , srv471245252:84 , srv605286216:84 , srv65885360:84 , srv688383480:84 , srv783284489:84 , srv795720528:84 , srv871094775:84 , srv934667668:84 , srv938140203:84 , srv962042754:84 , srv962758996:84 , srv980150633:84 , srv1014505571:85 , srv1026792101:85 , srv1056090899:85 , srv1082233162:85 , srv108896983:85 , srv1243163383:85 , srv1296100568:85 , srv1444677531:85 , srv1534272759:85 , srv1599474787:85 , srv1687652156:85 , srv1696784399:85 , srv1707691964:85 , srv1711621637:85 , srv1730509612:85 , srv1760245412:85 , srv1765573850:85 , srv1776437476:85 , srv1805860854:85 , srv1816357727:85 , srv1857197652:85 , srv1906865849:85 , srv1970388602:85 , srv2034926644:85 , srv2054256975:85 , srv2080318807:85 , srv304752276:85 , srv396926723:85 , srv415855941:85 , srv428985666:85 , srv459562527:85 , srv488118145:85 , srv510988442:85 , srv545891998:85 , srv57459637:85 , srv617669874:85 , srv691314394:85 , srv719993364:85 , srv767242899:85 , srv778694182:85 , srv78620003:85 , srv791871435:85 , srv8087327:85 , srv861362549:85 , srv86146228:85 , srv881189858:85 , srv891454926:85 , srv907093233:85 , srv97671276:85 , srv1074375515:86 , srv1203719740:86 , srv1244667675:86 , srv1297146282:86 , srv1553741991:86 , srv188099575:86 , srv34612551:86 , srv519579449:86 , srv605150982:86 , srv1313364607:623 }
2023-10-16 14:53:32,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-16 14:53:32,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1296100568=10, srv2060060046=49, srv1074375515=3, srv2113995425=53, srv1244667675=8, srv795720528=85, srv1658530229=25, srv1026792101=1, srv488118145=67, srv2080318807=51, srv396926723=61, srv767242899=80, srv1500800810=18, srv2113446162=52, srv605150982=72, srv1857197652=41, srv8087327=86, srv2054256975=48, srv301452705=58, srv1730509612=32, srv97671276=98, srv519579449=69, srv1816357727=40, srv108896983=5, srv1906865849=44, srv78620003=83, srv1696784399=27, srv459562527=65, srv1254432261=9, srv415855941=62, srv1410402642=15, srv791871435=84, srv938140203=94, srv1332920271=13, srv1388524455=14, srv1874391278=42, srv783284489=82, srv723545679=79, srv510988442=68, srv946903974=95, srv34612551=60, srv617669874=74, srv86146228=88, srv545891998=70, srv1056090899=2, srv1707691964=28, srv1243163383=7, srv1203719740=6, srv1746841180=33, srv1506301047=19, srv27718665=57, srv962758996=97, srv57459637=71, srv719993364=78, srv962042754=96, srv428985666=64, srv1957151759=45, srv881189858=90, srv861362549=87, srv691314394=77, srv1082233162=4, srv1599474787=23, srv1014505571=0, srv1457423726=17, srv1805860854=39, srv2034926644=47, srv871094775=89, srv891454926=91, srv471245252=66, srv65885360=75, srv1786301088=38, srv1970388602=46, srv1297146282=11, srv1687652156=26, srv188099575=43, srv268349111=56, srv1313364607=12, srv1534272759=20, srv1444677531=16, srv229741783=54, srv1776437476=37, srv1711621637=29, srv1760245412=34, srv1635625230=24, srv42333071=63, srv1595418461=22, srv2072341239=50, srv236037710=55, srv605286216=73, srv688383480=76, srv172523516=30, srv1765573850=35, srv980150633=99, srv1725724158=31, srv304752276=59, srv778694182=81, srv1553741991=21, srv934667668=93, srv1771425587=36, srv907093233=92} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-16 14:53:32,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-16 14:53:32,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-16 14:53:32,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-16 14:53:32,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-16 14:53:32,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-16 14:53:32,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-16 14:53:32,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-16 14:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-16 14:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-16 14:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-16 14:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-16 14:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-16 14:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-16 14:53:32,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-16 14:53:32,261 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.816745182227604E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-16 14:53:32,261 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv723545679:82 , srv1595418461:83 , srv27718665:83 , srv301452705:83 , srv946903974:83 , srv1254432261:84 , srv1332920271:84 , srv1388524455:84 , srv1410402642:84 , srv1457423726:84 , srv1500800810:84 , srv1506301047:84 , srv1635625230:84 , srv1658530229:84 , srv172523516:84 , srv1725724158:84 , srv1746841180:84 , srv1771425587:84 , srv1786301088:84 , srv1874391278:84 , srv1957151759:84 , srv2060060046:84 , srv2072341239:84 , srv2113446162:84 , srv2113995425:84 , srv229741783:84 , srv236037710:84 , srv268349111:84 , srv42333071:84 , srv471245252:84 , srv605286216:84 , srv65885360:84 , srv688383480:84 , srv783284489:84 , srv795720528:84 , srv871094775:84 , srv934667668:84 , srv938140203:84 , srv962042754:84 , srv962758996:84 , srv980150633:84 , srv1014505571:85 , srv1026792101:85 , srv1056090899:85 , srv1082233162:85 , srv108896983:85 , srv1243163383:85 , srv1296100568:85 , srv1444677531:85 , srv1534272759:85 , srv1599474787:85 , srv1687652156:85 , srv1696784399:85 , srv1707691964:85 , srv1711621637:85 , srv1730509612:85 , srv1760245412:85 , srv1765573850:85 , srv1776437476:85 , srv1805860854:85 , srv1816357727:85 , srv1857197652:85 , srv1906865849:85 , srv1970388602:85 , srv2034926644:85 , srv2054256975:85 , srv2080318807:85 , srv304752276:85 , srv396926723:85 , srv415855941:85 , srv428985666:85 , srv459562527:85 , srv488118145:85 , srv510988442:85 , srv545891998:85 , srv57459637:85 , srv617669874:85 , srv691314394:85 , srv719993364:85 , srv767242899:85 , srv778694182:85 , srv78620003:85 , srv791871435:85 , srv8087327:85 , srv861362549:85 , srv86146228:85 , srv881189858:85 , srv891454926:85 , srv907093233:85 , srv97671276:85 , srv1074375515:86 , srv1203719740:86 , srv1244667675:86 , srv1297146282:86 , srv1553741991:86 , srv188099575:86 , srv34612551:86 , srv519579449:86 , srv605150982:86 , srv1313364607:623 }
2023-10-16 14:53:32,285 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=355 (was 369), ProcessCount=169 (was 169), AvailableMemoryMB=4840 (was 5337)
2023-10-16 14:53:32,292 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=355, ProcessCount=169, AvailableMemoryMB=4840
2023-10-16 14:53:32,293 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-16 14:53:32,293 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-16 14:53:32,301 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1024604155:84 , srv1067590920:84 , srv1142153799:84 , srv1209971768:84 , srv1220717177:84 , srv1241491938:84 , srv1350450050:84 , srv1646152750:84 , srv1800169607:84 , srv1800968300:84 , srv1853593666:84 , srv1867638816:84 , srv1896858765:84 , srv1937820076:84 , srv196814864:84 , srv1973305677:84 , srv1996088024:84 , srv2007114827:84 , srv2089279824:84 , srv2137550592:84 , srv30252721:84 , srv317208452:84 , srv323769032:84 , srv388566207:84 , srv430522913:84 , srv852931567:84 , srv917236692:84 , srv96694799:84 , srv983296654:84 , srv196228439:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-16 14:53:32,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-16 14:53:32,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2137550592=20, srv2007114827=18, srv388566207=24, srv1896858765=12, srv1996088024=17, srv1024604155=0, srv1350450050=6, srv852931567=26, srv1209971768=3, srv30252721=21, srv1853593666=10, srv196814864=15, srv1800968300=9, srv323769032=23, srv1800169607=8, srv2089279824=19, srv317208452=22, srv196228439=14, srv1142153799=2, srv1067590920=1, srv917236692=27, srv1973305677=16, srv983296654=29, srv96694799=28, srv1867638816=11, srv1646152750=7, srv1220717177=4, srv1241491938=5, srv430522913=25, srv1937820076=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-16 14:53:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-16 14:53:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-16 14:53:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-16 14:53:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-16 14:53:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-16 14:53:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-16 14:53:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-16 14:53:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-16 14:53:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-16 14:53:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-16 14:53:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-16 14:53:32,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-16 14:53:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-16 14:53:32,329 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1076353597897979, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-16 14:53:32,329 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912532198768359, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1076353597897979, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-16 14:55:32,316 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6280217 different iterations.  Found a solution that moves 1841 regions; Going from a computed imbalance of 0.9912532198768359 to a new imbalance of 4.296985841319951E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6818518518518518, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-16 14:55:32,324 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1024604155:90 , srv1067590920:90 , srv1142153799:90 , srv1209971768:90 , srv1220717177:90 , srv1241491938:90 , srv1350450050:90 , srv1646152750:90 , srv1800169607:90 , srv1800968300:90 , srv1853593666:90 , srv1867638816:90 , srv1896858765:90 , srv1937820076:90 , srv196228439:90 , srv196814864:90 , srv1973305677:90 , srv1996088024:90 , srv2007114827:90 , srv2089279824:90 , srv2137550592:90 , srv30252721:90 , srv317208452:90 , srv323769032:90 , srv388566207:90 , srv430522913:90 , srv852931567:90 , srv917236692:90 , srv96694799:90 , srv983296654:90 }
2023-10-16 14:55:32,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-16 14:55:32,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2137550592=20, srv2007114827=18, srv388566207=24, srv1896858765=12, srv1996088024=17, srv1024604155=0, srv1350450050=6, srv852931567=26, srv1209971768=3, srv30252721=21, srv1853593666=10, srv196814864=15, srv1800968300=9, srv323769032=23, srv1800169607=8, srv2089279824=19, srv317208452=22, srv196228439=14, srv1142153799=2, srv1067590920=1, srv917236692=27, srv1973305677=16, srv983296654=29, srv96694799=28, srv1867638816=11, srv1646152750=7, srv1220717177=4, srv1241491938=5, srv430522913=25, srv1937820076=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-16 14:55:32,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-16 14:55:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-16 14:55:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-16 14:55:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-16 14:55:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-16 14:55:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-16 14:55:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-16 14:55:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-16 14:55:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-16 14:55:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-16 14:55:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-16 14:55:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-16 14:55:32,342 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-16 14:55:32,342 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1024604155:90 , srv1067590920:90 , srv1142153799:90 , srv1209971768:90 , srv1220717177:90 , srv1241491938:90 , srv1350450050:90 , srv1646152750:90 , srv1800169607:90 , srv1800968300:90 , srv1853593666:90 , srv1867638816:90 , srv1896858765:90 , srv1937820076:90 , srv196228439:90 , srv196814864:90 , srv1973305677:90 , srv1996088024:90 , srv2007114827:90 , srv2089279824:90 , srv2137550592:90 , srv30252721:90 , srv317208452:90 , srv323769032:90 , srv388566207:90 , srv430522913:90 , srv852931567:90 , srv917236692:90 , srv96694799:90 , srv983296654:90 }
2023-10-16 14:55:32,354 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=179 (was 355), ProcessCount=167 (was 169), AvailableMemoryMB=4592 (was 4840)