2023-12-24 04:53:14,743 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-24 04:53:15,071 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-24 04:53:15,189 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-24 04:53:15,264 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-24 04:53:15,274 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-24 04:53:15,289 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=263, ProcessCount=171, AvailableMemoryMB=12222
2023-12-24 04:53:15,292 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-24 04:53:15,292 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-24 04:53:15,421 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1001421043:84 , srv1007573388:84 , srv1035230808:84 , srv104172202:84 , srv108480597:84 , srv1185688401:84 , srv1221426601:84 , srv1251922423:84 , srv1256102901:84 , srv1270545944:84 , srv1289516237:84 , srv1300328441:84 , srv1321069055:84 , srv137588302:84 , srv1398544:84 , srv1424026248:84 , srv14248319:84 , srv146909303:84 , srv1490327227:84 , srv151421532:84 , srv1551967832:84 , srv1635231620:84 , srv1642748635:84 , srv1642763443:84 , srv1643545408:84 , srv1645460939:84 , srv1664144782:84 , srv1665633773:84 , srv1686363663:84 , srv1703665909:84 , srv1715208535:84 , srv1719371314:84 , srv1741541991:84 , srv1756560609:84 , srv1762016982:84 , srv1796639017:84 , srv1818098462:84 , srv1827215408:84 , srv1842212594:84 , srv1849979252:84 , srv1874454195:84 , srv1875024699:84 , srv1953790678:84 , srv1955971620:84 , srv1958204886:84 , srv1981260374:84 , srv199524400:84 , srv2047795152:84 , srv2055090866:84 , srv2057033546:84 , srv2058631975:84 , srv2061614894:84 , srv2066917380:84 , srv2072416992:84 , srv2076980251:84 , srv2077641624:84 , srv2094811000:84 , srv2098330327:84 , srv2137980359:84 , srv225685435:84 , srv232580482:84 , srv233137686:84 , srv257565025:84 , srv277615717:84 , srv27916881:84 , srv324374621:84 , srv33798730:84 , srv362933697:84 , srv383790797:84 , srv385109786:84 , srv388608138:84 , srv393220471:84 , srv411450355:84 , srv411806388:84 , srv430666874:84 , srv434881207:84 , srv443804934:84 , srv446112811:84 , srv462145742:84 , srv463142426:84 , srv511051783:84 , srv532033431:84 , srv602616186:84 , srv64593296:84 , srv653194333:84 , srv657749760:84 , srv66225611:84 , srv671333472:84 , srv680690269:84 , srv719028971:84 , srv732395322:84 , srv786619745:84 , srv834091482:84 , srv841560632:84 , srv842796714:84 , srv852625665:84 , srv860384867:84 , srv937575947:84 , srv99222292:84 , srv1647204747:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-24 04:53:15,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-24 04:53:15,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1647204747=26, srv786619745=92, srv1719371314=32, srv257565025=63, srv1035230808=2, srv1251922423=7, srv2047795152=48, srv2057033546=50, srv232580482=61, srv1955971620=44, srv33798730=67, srv841560632=94, srv657749760=86, srv680690269=89, srv1715208535=31, srv1741541991=33, srv1958204886=45, srv1256102901=8, srv1551967832=20, srv99222292=99, srv1756560609=34, srv430666874=75, srv2076980251=55, srv446112811=78, srv1643545408=24, srv2077641624=56, srv2072416992=54, srv732395322=91, srv383790797=69, srv1664144782=27, srv1321069055=12, srv1665633773=28, srv66225611=87, srv388608138=71, srv137588302=13, srv14248319=16, srv434881207=76, srv151421532=19, srv411450355=73, srv411806388=74, srv362933697=68, srv1827215408=38, srv462145742=79, srv532033431=82, srv1270545944=9, srv1849979252=40, srv64593296=84, srv1842212594=39, srv1818098462=37, srv324374621=66, srv1424026248=15, srv2058631975=51, srv2066917380=53, srv1796639017=36, srv834091482=93, srv463142426=80, srv1185688401=5, srv1874454195=41, srv1007573388=1, srv671333472=88, srv108480597=4, srv1981260374=46, srv199524400=47, srv2055090866=49, srv393220471=72, srv233137686=62, srv1398544=14, srv27916881=65, srv443804934=77, srv719028971=90, srv146909303=17, srv1635231620=21, srv1762016982=35, srv2098330327=58, srv653194333=85, srv937575947=98, srv1001421043=0, srv860384867=97, srv1875024699=42, srv104172202=3, srv852625665=96, srv1686363663=29, srv1642763443=23, srv1289516237=10, srv2061614894=52, srv602616186=83, srv277615717=64, srv511051783=81, srv1645460939=25, srv1221426601=6, srv2094811000=57, srv842796714=95, srv1300328441=11, srv1642748635=22, srv225685435=60, srv2137980359=59, srv1490327227=18, srv1953790678=43, srv385109786=70, srv1703665909=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-24 04:53:15,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-24 04:53:15,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-24 04:53:15,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-24 04:53:15,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-24 04:53:15,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-24 04:53:15,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-24 04:53:15,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-24 04:53:15,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-24 04:53:15,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-24 04:53:15,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-24 04:53:15,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-24 04:53:15,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-24 04:53:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-24 04:53:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-24 04:53:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-24 04:53:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-24 04:53:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-24 04:53:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-24 04:53:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-24 04:53:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-24 04:53:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-24 04:53:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-24 04:53:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-24 04:53:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-24 04:53:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-24 04:53:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-24 04:53:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-24 04:53:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-24 04:53:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-24 04:53:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-24 04:53:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-24 04:53:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-24 04:53:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-24 04:53:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-24 04:53:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-24 04:53:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-24 04:53:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-24 04:53:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-24 04:53:15,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-24 04:53:15,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-24 04:53:15,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-24 04:53:15,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-24 04:53:15,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-24 04:53:15,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-24 04:53:15,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-24 04:53:15,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-24 04:53:15,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-24 04:53:15,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-24 04:53:15,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-24 04:53:15,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-24 04:53:15,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-24 04:53:15,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-24 04:53:15,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-24 04:53:15,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-24 04:53:15,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-24 04:53:15,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-24 04:53:15,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-24 04:53:15,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-24 04:53:15,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-24 04:53:15,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-24 04:53:15,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-24 04:53:15,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-24 04:53:15,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-24 04:53:15,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-24 04:53:15,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-24 04:53:15,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-24 04:53:15,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-24 04:53:15,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-24 04:53:15,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-24 04:53:15,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-24 04:53:15,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-24 04:53:15,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-24 04:53:15,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-24 04:53:15,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-24 04:53:15,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-24 04:53:15,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-24 04:53:15,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-24 04:53:15,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-24 04:53:15,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-24 04:53:15,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-24 04:53:15,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-24 04:53:15,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-24 04:53:15,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-24 04:53:15,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-24 04:53:15,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-24 04:53:15,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-24 04:53:15,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-24 04:53:15,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-24 04:53:15,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-24 04:53:15,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-24 04:53:15,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-24 04:53:15,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-24 04:53:15,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-24 04:53:15,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-24 04:53:15,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-24 04:53:15,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-24 04:53:15,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-24 04:53:15,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-24 04:53:15,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-24 04:53:15,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-24 04:53:15,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-24 04:53:15,803 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:53:15,803 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-24 04:53:15,804 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-24 04:53:16,275 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 707 ms to try 5000 different iterations.  Found a solution that moves 4699 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18184148543634146. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03814602328102012, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05202088849208722, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5221111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03814602328102012, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17733333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:53:16,290 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2058631975:82 , srv1270545944:83 , srv1289516237:83 , srv151421532:83 , srv1818098462:83 , srv1874454195:83 , srv430666874:83 , srv434881207:83 , srv463142426:83 , srv653194333:83 , srv786619745:83 , srv1300328441:84 , srv1635231620:84 , srv1642763443:84 , srv1955971620:84 , srv2066917380:84 , srv2098330327:84 , srv27916881:84 , srv383790797:84 , srv104172202:85 , srv1256102901:85 , srv1398544:85 , srv14248319:85 , srv1551967832:85 , srv1665633773:85 , srv1741541991:85 , srv1827215408:85 , srv1953790678:85 , srv1958204886:85 , srv2061614894:85 , srv385109786:85 , srv443804934:85 , srv657749760:85 , srv842796714:85 , srv99222292:85 , srv1642748635:86 , srv1719371314:86 , srv1796639017:86 , srv1849979252:86 , srv2047795152:86 , srv2055090866:86 , srv277615717:86 , srv33798730:86 , srv411450355:86 , srv511051783:86 , srv602616186:86 , srv64593296:86 , srv66225611:86 , srv671333472:86 , srv680690269:86 , srv732395322:86 , srv860384867:86 , srv1035230808:87 , srv1424026248:87 , srv146909303:87 , srv1490327227:87 , srv1643545408:87 , srv1664144782:87 , srv1686363663:87 , srv1703665909:87 , srv1762016982:87 , srv1875024699:87 , srv1981260374:87 , srv2094811000:87 , srv393220471:87 , srv446112811:87 , srv462145742:87 , srv719028971:87 , srv834091482:87 , srv937575947:87 , srv1251922423:88 , srv137588302:88 , srv1715208535:88 , srv1842212594:88 , srv2057033546:88 , srv2072416992:88 , srv232580482:88 , srv257565025:88 , srv362933697:88 , srv1001421043:89 , srv1185688401:89 , srv1645460939:89 , srv2077641624:89 , srv2137980359:89 , srv233137686:89 , srv388608138:89 , srv411806388:89 , srv841560632:89 , srv852625665:89 , srv1007573388:90 , srv225685435:90 , srv1756560609:91 , srv199524400:91 , srv108480597:92 , srv1221426601:92 , srv1321069055:92 , srv2076980251:92 , srv324374621:93 , srv532033431:94 , srv1647204747:429 }
2023-12-24 04:53:16,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-24 04:53:16,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1647204747=26, srv786619745=92, srv1719371314=32, srv257565025=63, srv1035230808=2, srv1251922423=7, srv2047795152=48, srv2057033546=50, srv232580482=61, srv1955971620=44, srv33798730=67, srv841560632=94, srv657749760=86, srv680690269=89, srv1715208535=31, srv1741541991=33, srv1958204886=45, srv1256102901=8, srv1551967832=20, srv99222292=99, srv1756560609=34, srv430666874=75, srv2076980251=55, srv446112811=78, srv1643545408=24, srv2077641624=56, srv2072416992=54, srv732395322=91, srv383790797=69, srv1664144782=27, srv1321069055=12, srv1665633773=28, srv66225611=87, srv388608138=71, srv137588302=13, srv14248319=16, srv434881207=76, srv151421532=19, srv411450355=73, srv411806388=74, srv362933697=68, srv1827215408=38, srv462145742=79, srv532033431=82, srv1270545944=9, srv1849979252=40, srv64593296=84, srv1842212594=39, srv1818098462=37, srv324374621=66, srv1424026248=15, srv2058631975=51, srv2066917380=53, srv1796639017=36, srv834091482=93, srv463142426=80, srv1185688401=5, srv1874454195=41, srv1007573388=1, srv671333472=88, srv108480597=4, srv1981260374=46, srv199524400=47, srv2055090866=49, srv393220471=72, srv233137686=62, srv1398544=14, srv27916881=65, srv443804934=77, srv719028971=90, srv146909303=17, srv1635231620=21, srv1762016982=35, srv2098330327=58, srv653194333=85, srv937575947=98, srv1001421043=0, srv860384867=97, srv1875024699=42, srv104172202=3, srv852625665=96, srv1686363663=29, srv1642763443=23, srv1289516237=10, srv2061614894=52, srv602616186=83, srv277615717=64, srv511051783=81, srv1645460939=25, srv1221426601=6, srv2094811000=57, srv842796714=95, srv1300328441=11, srv1642748635=22, srv225685435=60, srv2137980359=59, srv1490327227=18, srv1953790678=43, srv385109786=70, srv1703665909=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-24 04:53:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-24 04:53:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-24 04:53:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-24 04:53:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-24 04:53:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-24 04:53:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-24 04:53:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-24 04:53:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-24 04:53:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-24 04:53:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-24 04:53:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-24 04:53:16,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-24 04:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-24 04:53:16,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-24 04:53:16,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-24 04:53:16,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-24 04:53:16,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-24 04:53:16,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-24 04:53:16,515 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03814602328102012, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05202088849208722, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03814602328102012, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17733333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:53:16,516 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-24 04:53:16,516 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1818085823350894, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03814602328102012, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05202088849208722, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03814602328102012, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17733333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-24 04:53:16,803 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 469 ms to try 5000 different iterations.  Found a solution that moves 2632 regions; Going from a computed imbalance of 0.1818085823350894 to a new imbalance of 0.01587986718457198. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020476917557032015); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03177149051315675, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29244444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020476917557032015); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:53:16,807 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv324374621:78 , srv1221426601:79 , srv199524400:79 , srv2076980251:79 , srv532033431:79 , srv1007573388:80 , srv108480597:80 , srv1321069055:80 , srv1756560609:81 , srv388608138:81 , srv1001421043:82 , srv1645460939:82 , srv233137686:82 , srv257565025:82 , srv841560632:82 , srv1715208535:83 , srv1875024699:83 , srv411806388:83 , srv1185688401:84 , srv1490327227:84 , srv2057033546:84 , srv2137980359:84 , srv225685435:84 , srv277615717:84 , srv362933697:84 , srv446112811:84 , srv66225611:84 , srv1251922423:85 , srv137588302:85 , srv146909303:85 , srv1643545408:85 , srv1664144782:85 , srv2047795152:85 , srv2072416992:85 , srv2077641624:85 , srv232580482:85 , srv393220471:85 , srv680690269:85 , srv732395322:85 , srv852625665:85 , srv937575947:85 , srv1256102901:86 , srv1424026248:86 , srv1642763443:86 , srv1665633773:86 , srv1703665909:86 , srv1849979252:86 , srv2055090866:86 , srv2094811000:86 , srv411450355:86 , srv511051783:86 , srv657749760:86 , srv719028971:86 , srv834091482:86 , srv842796714:86 , srv860384867:86 , srv1035230808:87 , srv104172202:87 , srv1289516237:87 , srv14248319:87 , srv1635231620:87 , srv1642748635:87 , srv1686363663:87 , srv1719371314:87 , srv1741541991:87 , srv1762016982:87 , srv1796639017:87 , srv1827215408:87 , srv1842212594:87 , srv1953790678:87 , srv1981260374:87 , srv2061614894:87 , srv2098330327:87 , srv33798730:87 , srv383790797:87 , srv385109786:87 , srv462145742:87 , srv602616186:87 , srv64593296:87 , srv99222292:87 , srv1551967832:88 , srv1874454195:88 , srv434881207:88 , srv443804934:88 , srv463142426:88 , srv786619745:88 , srv1398544:89 , srv1818098462:89 , srv1958204886:89 , srv2058631975:89 , srv2066917380:89 , srv430666874:89 , srv1270545944:90 , srv1300328441:90 , srv1955971620:90 , srv27916881:90 , srv671333472:90 , srv151421532:91 , srv653194333:91 , srv1647204747:527 }
2023-12-24 04:53:16,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-24 04:53:16,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1647204747=26, srv786619745=92, srv1719371314=32, srv257565025=63, srv1035230808=2, srv1251922423=7, srv2047795152=48, srv2057033546=50, srv232580482=61, srv1955971620=44, srv33798730=67, srv841560632=94, srv657749760=86, srv680690269=89, srv1715208535=31, srv1741541991=33, srv1958204886=45, srv1256102901=8, srv1551967832=20, srv99222292=99, srv1756560609=34, srv430666874=75, srv2076980251=55, srv446112811=78, srv1643545408=24, srv2077641624=56, srv2072416992=54, srv732395322=91, srv383790797=69, srv1664144782=27, srv1321069055=12, srv1665633773=28, srv66225611=87, srv388608138=71, srv137588302=13, srv14248319=16, srv434881207=76, srv151421532=19, srv411450355=73, srv411806388=74, srv362933697=68, srv1827215408=38, srv462145742=79, srv532033431=82, srv1270545944=9, srv1849979252=40, srv64593296=84, srv1842212594=39, srv1818098462=37, srv324374621=66, srv1424026248=15, srv2058631975=51, srv2066917380=53, srv1796639017=36, srv834091482=93, srv463142426=80, srv1185688401=5, srv1874454195=41, srv1007573388=1, srv671333472=88, srv108480597=4, srv1981260374=46, srv199524400=47, srv2055090866=49, srv393220471=72, srv233137686=62, srv1398544=14, srv27916881=65, srv443804934=77, srv719028971=90, srv146909303=17, srv1635231620=21, srv1762016982=35, srv2098330327=58, srv653194333=85, srv937575947=98, srv1001421043=0, srv860384867=97, srv1875024699=42, srv104172202=3, srv852625665=96, srv1686363663=29, srv1642763443=23, srv1289516237=10, srv2061614894=52, srv602616186=83, srv277615717=64, srv511051783=81, srv1645460939=25, srv1221426601=6, srv2094811000=57, srv842796714=95, srv1300328441=11, srv1642748635=22, srv225685435=60, srv2137980359=59, srv1490327227=18, srv1953790678=43, srv385109786=70, srv1703665909=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-24 04:53:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-24 04:53:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-24 04:53:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-24 04:53:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-24 04:53:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-24 04:53:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-24 04:53:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-24 04:53:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-24 04:53:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-24 04:53:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-24 04:53:16,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-24 04:53:16,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-24 04:53:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-24 04:53:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-24 04:53:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-24 04:53:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-24 04:53:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-24 04:53:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-24 04:53:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-24 04:53:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-24 04:53:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-24 04:53:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-24 04:53:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-24 04:53:16,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-24 04:53:16,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-24 04:53:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-24 04:53:16,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-24 04:53:16,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-24 04:53:16,955 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020476917557032015); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03177149051315675, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020476917557032015); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:53:16,955 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-24 04:53:16,956 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015861437526667004, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020476917557032015); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03177149051315675, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020476917557032015); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-24 04:53:17,212 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 354 ms to try 5000 different iterations.  Found a solution that moves 973 regions; Going from a computed imbalance of 0.015861437526667004 to a new imbalance of 7.710167101982843E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006674144702294853); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009296222517045283); MoveCostFunction : (multiplier=7.0, imbalance=0.10811111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006674144702294853); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:53:17,214 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1842212594:82 , srv151421532:83 , srv1642748635:83 , srv1686363663:83 , srv1955971620:83 , srv1958204886:83 , srv2077641624:83 , srv671333472:83 , srv852625665:83 , srv1035230808:84 , srv108480597:84 , srv1300328441:84 , srv137588302:84 , srv1398544:84 , srv1551967832:84 , srv1703665909:84 , srv1719371314:84 , srv1981260374:84 , srv2061614894:84 , srv2066917380:84 , srv2094811000:84 , srv225685435:84 , srv232580482:84 , srv33798730:84 , srv362933697:84 , srv443804934:84 , srv462145742:84 , srv64593296:84 , srv653194333:84 , srv719028971:84 , srv834091482:84 , srv1185688401:85 , srv1251922423:85 , srv14248319:85 , srv1490327227:85 , srv1741541991:85 , srv1756560609:85 , srv1762016982:85 , srv1796639017:85 , srv1818098462:85 , srv1827215408:85 , srv1849979252:85 , srv2072416992:85 , srv2098330327:85 , srv27916881:85 , srv385109786:85 , srv393220471:85 , srv411450355:85 , srv411806388:85 , srv463142426:85 , srv532033431:85 , srv602616186:85 , srv786619745:85 , srv937575947:85 , srv104172202:86 , srv1221426601:86 , srv1270545944:86 , srv1289516237:86 , srv1321069055:86 , srv1424026248:86 , srv146909303:86 , srv1643545408:86 , srv1645460939:86 , srv1664144782:86 , srv1665633773:86 , srv1874454195:86 , srv1953790678:86 , srv2055090866:86 , srv2057033546:86 , srv2058631975:86 , srv2137980359:86 , srv233137686:86 , srv383790797:86 , srv430666874:86 , srv434881207:86 , srv446112811:86 , srv511051783:86 , srv841560632:86 , srv842796714:86 , srv860384867:86 , srv99222292:86 , srv1001421043:87 , srv1256102901:87 , srv1635231620:87 , srv1642763443:87 , srv1715208535:87 , srv1875024699:87 , srv199524400:87 , srv2047795152:87 , srv2076980251:87 , srv257565025:87 , srv277615717:87 , srv324374621:87 , srv388608138:87 , srv657749760:87 , srv66225611:87 , srv732395322:87 , srv1007573388:88 , srv680690269:88 , srv1647204747:561 }
2023-12-24 04:53:17,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-24 04:53:17,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1647204747=26, srv786619745=92, srv1719371314=32, srv257565025=63, srv1035230808=2, srv1251922423=7, srv2047795152=48, srv2057033546=50, srv232580482=61, srv1955971620=44, srv33798730=67, srv841560632=94, srv657749760=86, srv680690269=89, srv1715208535=31, srv1741541991=33, srv1958204886=45, srv1256102901=8, srv1551967832=20, srv99222292=99, srv1756560609=34, srv430666874=75, srv2076980251=55, srv446112811=78, srv1643545408=24, srv2077641624=56, srv2072416992=54, srv732395322=91, srv383790797=69, srv1664144782=27, srv1321069055=12, srv1665633773=28, srv66225611=87, srv388608138=71, srv137588302=13, srv14248319=16, srv434881207=76, srv151421532=19, srv411450355=73, srv411806388=74, srv362933697=68, srv1827215408=38, srv462145742=79, srv532033431=82, srv1270545944=9, srv1849979252=40, srv64593296=84, srv1842212594=39, srv1818098462=37, srv324374621=66, srv1424026248=15, srv2058631975=51, srv2066917380=53, srv1796639017=36, srv834091482=93, srv463142426=80, srv1185688401=5, srv1874454195=41, srv1007573388=1, srv671333472=88, srv108480597=4, srv1981260374=46, srv199524400=47, srv2055090866=49, srv393220471=72, srv233137686=62, srv1398544=14, srv27916881=65, srv443804934=77, srv719028971=90, srv146909303=17, srv1635231620=21, srv1762016982=35, srv2098330327=58, srv653194333=85, srv937575947=98, srv1001421043=0, srv860384867=97, srv1875024699=42, srv104172202=3, srv852625665=96, srv1686363663=29, srv1642763443=23, srv1289516237=10, srv2061614894=52, srv602616186=83, srv277615717=64, srv511051783=81, srv1645460939=25, srv1221426601=6, srv2094811000=57, srv842796714=95, srv1300328441=11, srv1642748635=22, srv225685435=60, srv2137980359=59, srv1490327227=18, srv1953790678=43, srv385109786=70, srv1703665909=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-24 04:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-24 04:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-24 04:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-24 04:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-24 04:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-24 04:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-24 04:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-24 04:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-24 04:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-24 04:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-24 04:53:17,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-24 04:53:17,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-24 04:53:17,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-24 04:53:17,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-24 04:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-24 04:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-24 04:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-24 04:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-24 04:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-24 04:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-24 04:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-24 04:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-24 04:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-24 04:53:17,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-24 04:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-24 04:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-24 04:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-24 04:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-24 04:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-24 04:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-24 04:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-24 04:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-24 04:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-24 04:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-24 04:53:17,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-24 04:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-24 04:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-24 04:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-24 04:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-24 04:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-24 04:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-24 04:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-24 04:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-24 04:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-24 04:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-24 04:53:17,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-24 04:53:17,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-24 04:53:17,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-24 04:53:17,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-24 04:53:17,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-24 04:53:17,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-24 04:53:17,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-24 04:53:17,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-24 04:53:17,347 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006674144702294853); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009296222517045283); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006674144702294853); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:53:17,347 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-24 04:53:17,348 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.642036185791572E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006674144702294853); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009296222517045283); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006674144702294853); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-24 04:53:17,712 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 463 ms to try 5000 different iterations.  Found a solution that moves 283 regions; Going from a computed imbalance of 7.642036185791572E-4 to a new imbalance of 5.2561818472170376E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.03144444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:53:17,713 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1007573388:83 , srv1270545944:83 , srv1762016982:83 , srv1818098462:83 , srv2137980359:83 , srv27916881:83 , srv671333472:83 , srv680690269:83 , srv732395322:83 , srv1001421043:84 , srv1035230808:84 , srv104172202:84 , srv1185688401:84 , srv1221426601:84 , srv1251922423:84 , srv1256102901:84 , srv1300328441:84 , srv1321069055:84 , srv1398544:84 , srv1424026248:84 , srv146909303:84 , srv1635231620:84 , srv1643545408:84 , srv1664144782:84 , srv1665633773:84 , srv1796639017:84 , srv1875024699:84 , srv1953790678:84 , srv1981260374:84 , srv2047795152:84 , srv2055090866:84 , srv2057033546:84 , srv2072416992:84 , srv2076980251:84 , srv225685435:84 , srv324374621:84 , srv411806388:84 , srv462145742:84 , srv511051783:84 , srv532033431:84 , srv653194333:84 , srv657749760:84 , srv860384867:84 , srv99222292:84 , srv137588302:85 , srv14248319:85 , srv1551967832:85 , srv1642763443:85 , srv1645460939:85 , srv1686363663:85 , srv1703665909:85 , srv1715208535:85 , srv1719371314:85 , srv1741541991:85 , srv1756560609:85 , srv1827215408:85 , srv1842212594:85 , srv1849979252:85 , srv1874454195:85 , srv1955971620:85 , srv1958204886:85 , srv199524400:85 , srv2058631975:85 , srv2061614894:85 , srv2066917380:85 , srv232580482:85 , srv233137686:85 , srv277615717:85 , srv33798730:85 , srv383790797:85 , srv385109786:85 , srv388608138:85 , srv393220471:85 , srv411450355:85 , srv430666874:85 , srv434881207:85 , srv443804934:85 , srv446112811:85 , srv602616186:85 , srv64593296:85 , srv66225611:85 , srv719028971:85 , srv834091482:85 , srv841560632:85 , srv842796714:85 , srv852625665:85 , srv937575947:85 , srv108480597:86 , srv1289516237:86 , srv1490327227:86 , srv151421532:86 , srv1642748635:86 , srv2077641624:86 , srv2094811000:86 , srv2098330327:86 , srv257565025:86 , srv362933697:86 , srv463142426:86 , srv786619745:86 , srv1647204747:626 }
2023-12-24 04:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-24 04:53:17,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1647204747=26, srv786619745=92, srv1719371314=32, srv257565025=63, srv1035230808=2, srv1251922423=7, srv2047795152=48, srv2057033546=50, srv232580482=61, srv1955971620=44, srv33798730=67, srv841560632=94, srv657749760=86, srv680690269=89, srv1715208535=31, srv1741541991=33, srv1958204886=45, srv1256102901=8, srv1551967832=20, srv99222292=99, srv1756560609=34, srv430666874=75, srv2076980251=55, srv446112811=78, srv1643545408=24, srv2077641624=56, srv2072416992=54, srv732395322=91, srv383790797=69, srv1664144782=27, srv1321069055=12, srv1665633773=28, srv66225611=87, srv388608138=71, srv137588302=13, srv14248319=16, srv434881207=76, srv151421532=19, srv411450355=73, srv411806388=74, srv362933697=68, srv1827215408=38, srv462145742=79, srv532033431=82, srv1270545944=9, srv1849979252=40, srv64593296=84, srv1842212594=39, srv1818098462=37, srv324374621=66, srv1424026248=15, srv2058631975=51, srv2066917380=53, srv1796639017=36, srv834091482=93, srv463142426=80, srv1185688401=5, srv1874454195=41, srv1007573388=1, srv671333472=88, srv108480597=4, srv1981260374=46, srv199524400=47, srv2055090866=49, srv393220471=72, srv233137686=62, srv1398544=14, srv27916881=65, srv443804934=77, srv719028971=90, srv146909303=17, srv1635231620=21, srv1762016982=35, srv2098330327=58, srv653194333=85, srv937575947=98, srv1001421043=0, srv860384867=97, srv1875024699=42, srv104172202=3, srv852625665=96, srv1686363663=29, srv1642763443=23, srv1289516237=10, srv2061614894=52, srv602616186=83, srv277615717=64, srv511051783=81, srv1645460939=25, srv1221426601=6, srv2094811000=57, srv842796714=95, srv1300328441=11, srv1642748635=22, srv225685435=60, srv2137980359=59, srv1490327227=18, srv1953790678=43, srv385109786=70, srv1703665909=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-24 04:53:17,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-24 04:53:17,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-24 04:53:17,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-24 04:53:17,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-24 04:53:17,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-24 04:53:17,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-24 04:53:17,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-24 04:53:17,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-24 04:53:17,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-24 04:53:17,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-24 04:53:17,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-24 04:53:17,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-24 04:53:17,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-24 04:53:17,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-24 04:53:17,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-24 04:53:17,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-24 04:53:17,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-24 04:53:17,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-24 04:53:17,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-24 04:53:17,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-24 04:53:17,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-24 04:53:17,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-24 04:53:17,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-24 04:53:17,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-24 04:53:17,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-24 04:53:17,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-24 04:53:17,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-24 04:53:17,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-24 04:53:17,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-24 04:53:17,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-24 04:53:17,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-24 04:53:17,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-24 04:53:17,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-24 04:53:17,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-24 04:53:17,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-24 04:53:17,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-24 04:53:17,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-24 04:53:17,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-24 04:53:17,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-24 04:53:17,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-24 04:53:17,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-24 04:53:17,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-24 04:53:17,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-24 04:53:17,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-24 04:53:17,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-24 04:53:17,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-24 04:53:17,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-24 04:53:17,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-24 04:53:17,847 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:53:17,847 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-24 04:53:17,847 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.058021011840577E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-24 04:53:18,104 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 358 ms to try 5000 different iterations.  Found a solution that moves 46 regions; Going from a computed imbalance of 5.058021011840577E-5 to a new imbalance of 7.709856384670057E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.005111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:53:18,104 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1424026248:83 , srv151421532:83 , srv1715208535:83 , srv2077641624:83 , srv2094811000:83 , srv257565025:83 , srv430666874:83 , srv602616186:83 , srv1001421043:84 , srv1035230808:84 , srv104172202:84 , srv108480597:84 , srv1185688401:84 , srv1251922423:84 , srv1256102901:84 , srv1270545944:84 , srv1289516237:84 , srv1300328441:84 , srv1321069055:84 , srv137588302:84 , srv1398544:84 , srv14248319:84 , srv146909303:84 , srv1490327227:84 , srv1551967832:84 , srv1635231620:84 , srv1642748635:84 , srv1642763443:84 , srv1643545408:84 , srv1645460939:84 , srv1664144782:84 , srv1686363663:84 , srv1703665909:84 , srv1719371314:84 , srv1741541991:84 , srv1756560609:84 , srv1762016982:84 , srv1796639017:84 , srv1827215408:84 , srv1842212594:84 , srv1849979252:84 , srv1874454195:84 , srv1953790678:84 , srv1955971620:84 , srv1958204886:84 , srv1981260374:84 , srv199524400:84 , srv2047795152:84 , srv2055090866:84 , srv2057033546:84 , srv2058631975:84 , srv2066917380:84 , srv2072416992:84 , srv2076980251:84 , srv2098330327:84 , srv2137980359:84 , srv225685435:84 , srv232580482:84 , srv233137686:84 , srv277615717:84 , srv27916881:84 , srv324374621:84 , srv33798730:84 , srv362933697:84 , srv383790797:84 , srv385109786:84 , srv388608138:84 , srv393220471:84 , srv411450355:84 , srv434881207:84 , srv443804934:84 , srv446112811:84 , srv462145742:84 , srv463142426:84 , srv511051783:84 , srv532033431:84 , srv64593296:84 , srv653194333:84 , srv657749760:84 , srv66225611:84 , srv671333472:84 , srv680690269:84 , srv719028971:84 , srv786619745:84 , srv834091482:84 , srv841560632:84 , srv842796714:84 , srv852625665:84 , srv860384867:84 , srv937575947:84 , srv99222292:84 , srv1007573388:85 , srv1221426601:85 , srv1665633773:85 , srv1875024699:85 , srv2061614894:85 , srv411806388:85 , srv732395322:85 , srv1818098462:86 , srv1647204747:683 }
2023-12-24 04:53:18,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-24 04:53:18,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1647204747=26, srv786619745=92, srv1719371314=32, srv257565025=63, srv1035230808=2, srv1251922423=7, srv2047795152=48, srv2057033546=50, srv232580482=61, srv1955971620=44, srv33798730=67, srv841560632=94, srv657749760=86, srv680690269=89, srv1715208535=31, srv1741541991=33, srv1958204886=45, srv1256102901=8, srv1551967832=20, srv99222292=99, srv1756560609=34, srv430666874=75, srv2076980251=55, srv446112811=78, srv1643545408=24, srv2077641624=56, srv2072416992=54, srv732395322=91, srv383790797=69, srv1664144782=27, srv1321069055=12, srv1665633773=28, srv66225611=87, srv388608138=71, srv137588302=13, srv14248319=16, srv434881207=76, srv151421532=19, srv411450355=73, srv411806388=74, srv362933697=68, srv1827215408=38, srv462145742=79, srv532033431=82, srv1270545944=9, srv1849979252=40, srv64593296=84, srv1842212594=39, srv1818098462=37, srv324374621=66, srv1424026248=15, srv2058631975=51, srv2066917380=53, srv1796639017=36, srv834091482=93, srv463142426=80, srv1185688401=5, srv1874454195=41, srv1007573388=1, srv671333472=88, srv108480597=4, srv1981260374=46, srv199524400=47, srv2055090866=49, srv393220471=72, srv233137686=62, srv1398544=14, srv27916881=65, srv443804934=77, srv719028971=90, srv146909303=17, srv1635231620=21, srv1762016982=35, srv2098330327=58, srv653194333=85, srv937575947=98, srv1001421043=0, srv860384867=97, srv1875024699=42, srv104172202=3, srv852625665=96, srv1686363663=29, srv1642763443=23, srv1289516237=10, srv2061614894=52, srv602616186=83, srv277615717=64, srv511051783=81, srv1645460939=25, srv1221426601=6, srv2094811000=57, srv842796714=95, srv1300328441=11, srv1642748635=22, srv225685435=60, srv2137980359=59, srv1490327227=18, srv1953790678=43, srv385109786=70, srv1703665909=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-24 04:53:18,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-24 04:53:18,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-24 04:53:18,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-24 04:53:18,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-24 04:53:18,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-24 04:53:18,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-24 04:53:18,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-24 04:53:18,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-24 04:53:18,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-24 04:53:18,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-24 04:53:18,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-24 04:53:18,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-24 04:53:18,230 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:53:18,231 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1424026248:83 , srv151421532:83 , srv1715208535:83 , srv2077641624:83 , srv2094811000:83 , srv257565025:83 , srv430666874:83 , srv602616186:83 , srv1001421043:84 , srv1035230808:84 , srv104172202:84 , srv108480597:84 , srv1185688401:84 , srv1251922423:84 , srv1256102901:84 , srv1270545944:84 , srv1289516237:84 , srv1300328441:84 , srv1321069055:84 , srv137588302:84 , srv1398544:84 , srv14248319:84 , srv146909303:84 , srv1490327227:84 , srv1551967832:84 , srv1635231620:84 , srv1642748635:84 , srv1642763443:84 , srv1643545408:84 , srv1645460939:84 , srv1664144782:84 , srv1686363663:84 , srv1703665909:84 , srv1719371314:84 , srv1741541991:84 , srv1756560609:84 , srv1762016982:84 , srv1796639017:84 , srv1827215408:84 , srv1842212594:84 , srv1849979252:84 , srv1874454195:84 , srv1953790678:84 , srv1955971620:84 , srv1958204886:84 , srv1981260374:84 , srv199524400:84 , srv2047795152:84 , srv2055090866:84 , srv2057033546:84 , srv2058631975:84 , srv2066917380:84 , srv2072416992:84 , srv2076980251:84 , srv2098330327:84 , srv2137980359:84 , srv225685435:84 , srv232580482:84 , srv233137686:84 , srv277615717:84 , srv27916881:84 , srv324374621:84 , srv33798730:84 , srv362933697:84 , srv383790797:84 , srv385109786:84 , srv388608138:84 , srv393220471:84 , srv411450355:84 , srv434881207:84 , srv443804934:84 , srv446112811:84 , srv462145742:84 , srv463142426:84 , srv511051783:84 , srv532033431:84 , srv64593296:84 , srv653194333:84 , srv657749760:84 , srv66225611:84 , srv671333472:84 , srv680690269:84 , srv719028971:84 , srv786619745:84 , srv834091482:84 , srv841560632:84 , srv842796714:84 , srv852625665:84 , srv860384867:84 , srv937575947:84 , srv99222292:84 , srv1007573388:85 , srv1221426601:85 , srv1665633773:85 , srv1875024699:85 , srv2061614894:85 , srv411806388:85 , srv732395322:85 , srv1818098462:86 , srv1647204747:683 }
2023-12-24 04:53:18,253 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 263) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 171), AvailableMemoryMB=11630 (was 12222)
2023-12-24 04:53:18,260 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=169, AvailableMemoryMB=11630
2023-12-24 04:53:18,260 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-24 04:53:18,261 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-24 04:53:18,274 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv107635004:84 , srv1178888906:84 , srv120134454:84 , srv123688090:84 , srv1238771288:84 , srv1267918117:84 , srv1293676641:84 , srv1452555155:84 , srv1550861664:84 , srv16126378:84 , srv1619273390:84 , srv1624058374:84 , srv1643313294:84 , srv1890455602:84 , srv1904503630:84 , srv1911855709:84 , srv1932308809:84 , srv1957534928:84 , srv1963210784:84 , srv1986868131:84 , srv2004537475:84 , srv2043435281:84 , srv217803310:84 , srv239758967:84 , srv501713432:84 , srv502578532:84 , srv567290060:84 , srv674358100:84 , srv978028873:84 , srv285752603:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-24 04:53:18,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-24 04:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv217803310=22, srv1238771288=4, srv2043435281=21, srv1267918117=5, srv16126378=9, srv674358100=28, srv1911855709=15, srv567290060=27, srv1986868131=19, srv1550861664=8, srv285752603=24, srv120134454=2, srv978028873=29, srv501713432=25, srv1932308809=16, srv1293676641=6, srv107635004=0, srv123688090=3, srv1904503630=14, srv1619273390=10, srv1890455602=13, srv1957534928=17, srv1452555155=7, srv502578532=26, srv2004537475=20, srv1624058374=11, srv1963210784=18, srv1178888906=1, srv239758967=23, srv1643313294=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-24 04:53:18,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-24 04:53:18,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-24 04:53:18,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-24 04:53:18,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-24 04:53:18,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-24 04:53:18,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-24 04:53:18,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-24 04:53:18,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-24 04:53:18,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-24 04:53:18,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-24 04:53:18,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-24 04:53:18,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-24 04:53:18,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-24 04:53:18,307 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.086638114268035, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:53:18,307 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912466037133344, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.086638114268035, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-24 04:55:18,295 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5399362 different iterations.  Found a solution that moves 1853 regions; Going from a computed imbalance of 0.9912466037133344 to a new imbalance of 4.324994439959734E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6862962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:55:18,300 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv107635004:90 , srv1178888906:90 , srv120134454:90 , srv123688090:90 , srv1238771288:90 , srv1267918117:90 , srv1293676641:90 , srv1452555155:90 , srv1550861664:90 , srv16126378:90 , srv1619273390:90 , srv1624058374:90 , srv1643313294:90 , srv1890455602:90 , srv1904503630:90 , srv1911855709:90 , srv1932308809:90 , srv1957534928:90 , srv1963210784:90 , srv1986868131:90 , srv2004537475:90 , srv2043435281:90 , srv217803310:90 , srv239758967:90 , srv285752603:90 , srv501713432:90 , srv502578532:90 , srv567290060:90 , srv674358100:90 , srv978028873:90 }
2023-12-24 04:55:18,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-24 04:55:18,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv217803310=22, srv1238771288=4, srv2043435281=21, srv1267918117=5, srv16126378=9, srv674358100=28, srv1911855709=15, srv567290060=27, srv1986868131=19, srv1550861664=8, srv285752603=24, srv120134454=2, srv978028873=29, srv501713432=25, srv1932308809=16, srv1293676641=6, srv107635004=0, srv123688090=3, srv1904503630=14, srv1619273390=10, srv1890455602=13, srv1957534928=17, srv1452555155=7, srv502578532=26, srv2004537475=20, srv1624058374=11, srv1963210784=18, srv1178888906=1, srv239758967=23, srv1643313294=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-24 04:55:18,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-24 04:55:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-24 04:55:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-24 04:55:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-24 04:55:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-24 04:55:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-24 04:55:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-24 04:55:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-24 04:55:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-24 04:55:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-24 04:55:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-24 04:55:18,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-24 04:55:18,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-24 04:55:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-24 04:55:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-24 04:55:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-24 04:55:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-24 04:55:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-24 04:55:18,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-24 04:55:18,329 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-24 04:55:18,329 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv107635004:90 , srv1178888906:90 , srv120134454:90 , srv123688090:90 , srv1238771288:90 , srv1267918117:90 , srv1293676641:90 , srv1452555155:90 , srv1550861664:90 , srv16126378:90 , srv1619273390:90 , srv1624058374:90 , srv1643313294:90 , srv1890455602:90 , srv1904503630:90 , srv1911855709:90 , srv1932308809:90 , srv1957534928:90 , srv1963210784:90 , srv1986868131:90 , srv2004537475:90 , srv2043435281:90 , srv217803310:90 , srv239758967:90 , srv285752603:90 , srv501713432:90 , srv502578532:90 , srv567290060:90 , srv674358100:90 , srv978028873:90 }
2023-12-24 04:55:18,344 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 282), ProcessCount=167 (was 169), AvailableMemoryMB=10905 (was 11630)