2023-10-27 10:56:49,519 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-27 10:56:49,746 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-27 10:56:49,839 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-27 10:56:49,895 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-27 10:56:49,901 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-27 10:56:49,912 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=167, AvailableMemoryMB=8101
2023-10-27 10:56:49,914 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-27 10:56:49,914 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-27 10:56:50,030 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1019320115:84 , srv1039735823:84 , srv1107741113:84 , srv1142621184:84 , srv1146575751:84 , srv1187683171:84 , srv122294909:84 , srv1228988168:84 , srv1230088976:84 , srv1278544335:84 , srv1323962859:84 , srv1324784265:84 , srv1327444459:84 , srv1331705210:84 , srv1338886702:84 , srv134303378:84 , srv1354558613:84 , srv1365543949:84 , srv1384285777:84 , srv1430057757:84 , srv1493346767:84 , srv1499899140:84 , srv1505404096:84 , srv1520751040:84 , srv1527017398:84 , srv1558210361:84 , srv1658103945:84 , srv1664037161:84 , srv1698840835:84 , srv1703974151:84 , srv1707660103:84 , srv1739136141:84 , srv17436170:84 , srv1747036967:84 , srv1769754342:84 , srv17931338:84 , srv1811143300:84 , srv1828748640:84 , srv1830893285:84 , srv1831754449:84 , srv1850809639:84 , srv1890033720:84 , srv1916076545:84 , srv1926118423:84 , srv1929935042:84 , srv1962299994:84 , srv1964624573:84 , srv1972711906:84 , srv2046521012:84 , srv2092895442:84 , srv2098407440:84 , srv2105692420:84 , srv2121725174:84 , srv251098295:84 , srv309214960:84 , srv322574472:84 , srv332960176:84 , srv344124534:84 , srv367350340:84 , srv371072527:84 , srv455901440:84 , srv472733510:84 , srv479575647:84 , srv483684930:84 , srv484488658:84 , srv486402906:84 , srv497200819:84 , srv503902646:84 , srv507621037:84 , srv514839665:84 , srv517578785:84 , srv533537816:84 , srv534399026:84 , srv541895261:84 , srv570838946:84 , srv586641821:84 , srv606053997:84 , srv614502517:84 , srv646201063:84 , srv693476281:84 , srv715462997:84 , srv725044150:84 , srv773162886:84 , srv780138576:84 , srv788008917:84 , srv788103839:84 , srv792328581:84 , srv806387244:84 , srv851199301:84 , srv877035397:84 , srv889210940:84 , srv90425783:84 , srv909916015:84 , srv916963178:84 , srv91858150:84 , srv920762781:84 , srv941376199:84 , srv942910186:84 , srv957903305:84 , srv1485848098:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-27 10:56:50,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 10:56:50,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1187683171=5, srv1384285777=18, srv1499899140=22, srv17931338=36, srv486402906=66, srv1354558613=16, srv1739136141=32, srv1142621184=3, srv514839665=70, srv1039735823=1, srv367350340=59, srv792328581=87, srv134303378=15, srv1830893285=39, srv91858150=95, srv497200819=67, srv1831754449=40, srv2046521012=49, srv332960176=57, srv507621037=69, srv646201063=79, srv541895261=74, srv614502517=78, srv1769754342=35, srv17436170=33, srv1493346767=21, srv1505404096=23, srv1698840835=29, srv1278544335=9, srv725044150=82, srv1520751040=24, srv534399026=73, srv806387244=88, srv916963178=94, srv570838946=75, srv371072527=60, srv533537816=72, srv2098407440=51, srv788103839=86, srv1485848098=20, srv251098295=54, srv517578785=71, srv1230088976=8, srv889210940=91, srv1850809639=41, srv122294909=6, srv773162886=83, srv788008917=85, srv851199301=89, srv1338886702=14, srv1703974151=30, srv942910186=98, srv606053997=77, srv957903305=99, srv586641821=76, srv1964624573=47, srv309214960=55, srv1331705210=13, srv1527017398=25, srv455901440=61, srv479575647=63, srv1707660103=31, srv1228988168=7, srv1323962859=10, srv1926118423=44, srv909916015=93, srv1811143300=37, srv715462997=81, srv1962299994=46, srv1916076545=43, srv1972711906=48, srv1430057757=19, srv90425783=92, srv1327444459=12, srv1107741113=2, srv693476281=80, srv1365543949=17, srv1019320115=0, srv1664037161=28, srv344124534=58, srv1558210361=26, srv1747036967=34, srv1929935042=45, srv1146575751=4, srv2092895442=50, srv2121725174=53, srv1890033720=42, srv877035397=90, srv1324784265=11, srv483684930=64, srv2105692420=52, srv484488658=65, srv1828748640=38, srv472733510=62, srv941376199=97, srv1658103945=27, srv780138576=84, srv920762781=96, srv322574472=56, srv503902646=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 10:56:50,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 10:56:50,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 10:56:50,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 10:56:50,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 10:56:50,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 10:56:50,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 10:56:50,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 10:56:50,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 10:56:50,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 10:56:50,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 10:56:50,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 10:56:50,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 10:56:50,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 10:56:50,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 10:56:50,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 10:56:50,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 10:56:50,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 10:56:50,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 10:56:50,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 10:56:50,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 10:56:50,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 10:56:50,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 10:56:50,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 10:56:50,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 10:56:50,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 10:56:50,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 10:56:50,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 10:56:50,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 10:56:50,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 10:56:50,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 10:56:50,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 10:56:50,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 10:56:50,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 10:56:50,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 10:56:50,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 10:56:50,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 10:56:50,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 10:56:50,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 10:56:50,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 10:56:50,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 10:56:50,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 10:56:50,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 10:56:50,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 10:56:50,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 10:56:50,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 10:56:50,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 10:56:50,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 10:56:50,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 10:56:50,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 10:56:50,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 10:56:50,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 10:56:50,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 10:56:50,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 10:56:50,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 10:56:50,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 10:56:50,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 10:56:50,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 10:56:50,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 10:56:50,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 10:56:50,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 10:56:50,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 10:56:50,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 10:56:50,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 10:56:50,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 10:56:50,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 10:56:50,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 10:56:50,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 10:56:50,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 10:56:50,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 10:56:50,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 10:56:50,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 10:56:50,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 10:56:50,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 10:56:50,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 10:56:50,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 10:56:50,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 10:56:50,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 10:56:50,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 10:56:50,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 10:56:50,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 10:56:50,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 10:56:50,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 10:56:50,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 10:56:50,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 10:56:50,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 10:56:50,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 10:56:50,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 10:56:50,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 10:56:50,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 10:56:50,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 10:56:50,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 10:56:50,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 10:56:50,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 10:56:50,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 10:56:50,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 10:56:50,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 10:56:50,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 10:56:50,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 10:56:50,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 10:56:50,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 10:56:50,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 10:56:50,360 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 10:56:50,361 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 10:56:50,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 10:56:50,618 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 467 ms to try 5000 different iterations.  Found a solution that moves 4702 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1809861941498794. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04214299377334354, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057733082945934905, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5224444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04214299377334354, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17658333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.239, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 10:56:50,639 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv909916015:82 , srv1323962859:83 , srv1698840835:83 , srv2105692420:83 , srv344124534:83 , srv484488658:83 , srv877035397:83 , srv122294909:84 , srv1338886702:84 , srv1890033720:84 , srv1926118423:84 , srv251098295:84 , srv309214960:84 , srv367350340:84 , srv455901440:84 , srv479575647:84 , srv541895261:84 , srv942910186:84 , srv1142621184:85 , srv1327444459:85 , srv1430057757:85 , srv1493346767:85 , srv1505404096:85 , srv1520751040:85 , srv1527017398:85 , srv1558210361:85 , srv1658103945:85 , srv1769754342:85 , srv1828748640:85 , srv1831754449:85 , srv1964624573:85 , srv371072527:85 , srv486402906:85 , srv497200819:85 , srv517578785:85 , srv534399026:85 , srv606053997:85 , srv725044150:85 , srv941376199:85 , srv1107741113:86 , srv1228988168:86 , srv1324784265:86 , srv1331705210:86 , srv1365543949:86 , srv1739136141:86 , srv1747036967:86 , srv1811143300:86 , srv1916076545:86 , srv1929935042:86 , srv1962299994:86 , srv322574472:86 , srv507621037:86 , srv533537816:86 , srv788008917:86 , srv792328581:86 , srv889210940:86 , srv91858150:86 , srv1019320115:87 , srv1039735823:87 , srv1146575751:87 , srv1354558613:87 , srv17436170:87 , srv2098407440:87 , srv2121725174:87 , srv503902646:87 , srv514839665:87 , srv586641821:87 , srv614502517:87 , srv693476281:87 , srv788103839:87 , srv806387244:87 , srv916963178:87 , srv957903305:87 , srv1187683171:88 , srv1230088976:88 , srv1278544335:88 , srv1384285777:88 , srv1499899140:88 , srv1703974151:88 , srv1707660103:88 , srv1830893285:88 , srv1850809639:88 , srv1972711906:88 , srv2092895442:88 , srv472733510:88 , srv570838946:88 , srv646201063:88 , srv773162886:88 , srv780138576:88 , srv90425783:88 , srv920762781:88 , srv17931338:89 , srv2046521012:89 , srv1664037161:90 , srv483684930:90 , srv715462997:90 , srv851199301:90 , srv332960176:91 , srv134303378:93 , srv1485848098:465 }
2023-10-27 10:56:50,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 10:56:50,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1187683171=5, srv1384285777=18, srv1499899140=22, srv17931338=36, srv486402906=66, srv1354558613=16, srv1739136141=32, srv1142621184=3, srv514839665=70, srv1039735823=1, srv367350340=59, srv792328581=87, srv134303378=15, srv1830893285=39, srv91858150=95, srv497200819=67, srv1831754449=40, srv2046521012=49, srv332960176=57, srv507621037=69, srv646201063=79, srv541895261=74, srv614502517=78, srv1769754342=35, srv17436170=33, srv1493346767=21, srv1505404096=23, srv1698840835=29, srv1278544335=9, srv725044150=82, srv1520751040=24, srv534399026=73, srv806387244=88, srv916963178=94, srv570838946=75, srv371072527=60, srv533537816=72, srv2098407440=51, srv788103839=86, srv1485848098=20, srv251098295=54, srv517578785=71, srv1230088976=8, srv889210940=91, srv1850809639=41, srv122294909=6, srv773162886=83, srv788008917=85, srv851199301=89, srv1338886702=14, srv1703974151=30, srv942910186=98, srv606053997=77, srv957903305=99, srv586641821=76, srv1964624573=47, srv309214960=55, srv1331705210=13, srv1527017398=25, srv455901440=61, srv479575647=63, srv1707660103=31, srv1228988168=7, srv1323962859=10, srv1926118423=44, srv909916015=93, srv1811143300=37, srv715462997=81, srv1962299994=46, srv1916076545=43, srv1972711906=48, srv1430057757=19, srv90425783=92, srv1327444459=12, srv1107741113=2, srv693476281=80, srv1365543949=17, srv1019320115=0, srv1664037161=28, srv344124534=58, srv1558210361=26, srv1747036967=34, srv1929935042=45, srv1146575751=4, srv2092895442=50, srv2121725174=53, srv1890033720=42, srv877035397=90, srv1324784265=11, srv483684930=64, srv2105692420=52, srv484488658=65, srv1828748640=38, srv472733510=62, srv941376199=97, srv1658103945=27, srv780138576=84, srv920762781=96, srv322574472=56, srv503902646=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 10:56:50,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 10:56:50,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 10:56:50,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 10:56:50,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 10:56:50,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 10:56:50,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 10:56:50,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 10:56:50,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 10:56:50,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 10:56:50,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 10:56:50,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 10:56:50,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 10:56:50,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 10:56:50,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 10:56:50,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 10:56:50,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 10:56:50,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 10:56:50,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 10:56:50,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 10:56:50,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 10:56:50,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 10:56:50,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 10:56:50,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 10:56:50,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 10:56:50,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 10:56:50,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 10:56:50,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 10:56:50,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 10:56:50,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 10:56:50,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 10:56:50,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 10:56:50,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 10:56:50,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 10:56:50,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 10:56:50,775 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04214299377334354, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057733082945934905, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04214299377334354, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17658333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.239, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 10:56:50,776 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 10:56:50,776 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18095327004217834, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04214299377334354, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057733082945934905, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04214299377334354, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17658333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.239, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 10:56:50,943 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 256 ms to try 5000 different iterations.  Found a solution that moves 2590 regions; Going from a computed imbalance of 0.18095327004217834 to a new imbalance of 0.013687460846446184. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023530512066876966); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03485097341429191, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023530512066876966); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042166666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 10:56:50,954 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv134303378:81 , srv472733510:81 , srv17931338:82 , srv1850809639:82 , srv332960176:82 , srv773162886:82 , srv916963178:82 , srv1039735823:83 , srv1230088976:83 , srv17436170:83 , srv1916076545:83 , srv2046521012:83 , srv2092895442:83 , srv483684930:83 , srv503902646:83 , srv693476281:83 , srv715462997:83 , srv788008917:83 , srv1019320115:84 , srv1187683171:84 , srv1278544335:84 , srv1324784265:84 , srv1384285777:84 , srv1747036967:84 , srv514839665:84 , srv534399026:84 , srv570838946:84 , srv646201063:84 , srv90425783:84 , srv920762781:84 , srv1146575751:85 , srv1228988168:85 , srv1365543949:85 , srv1664037161:85 , srv1703974151:85 , srv1739136141:85 , srv1962299994:85 , srv1972711906:85 , srv251098295:85 , srv486402906:85 , srv497200819:85 , srv586641821:85 , srv614502517:85 , srv788103839:85 , srv806387244:85 , srv851199301:85 , srv1142621184:86 , srv1331705210:86 , srv1430057757:86 , srv1499899140:86 , srv1520751040:86 , srv1527017398:86 , srv1658103945:86 , srv1707660103:86 , srv2098407440:86 , srv2121725174:86 , srv344124534:86 , srv507621037:86 , srv517578785:86 , srv725044150:86 , srv780138576:86 , srv792328581:86 , srv942910186:86 , srv957903305:86 , srv1323962859:87 , srv1338886702:87 , srv1505404096:87 , srv1558210361:87 , srv1698840835:87 , srv1828748640:87 , srv1830893285:87 , srv1890033720:87 , srv1964624573:87 , srv322574472:87 , srv371072527:87 , srv479575647:87 , srv877035397:87 , srv889210940:87 , srv91858150:87 , srv1107741113:88 , srv1327444459:88 , srv1926118423:88 , srv1929935042:88 , srv2105692420:88 , srv455901440:88 , srv541895261:88 , srv606053997:88 , srv941376199:88 , srv122294909:89 , srv1493346767:89 , srv1769754342:89 , srv1811143300:89 , srv367350340:89 , srv909916015:89 , srv1354558613:90 , srv1831754449:90 , srv309214960:90 , srv484488658:90 , srv533537816:90 , srv1485848098:518 }
2023-10-27 10:56:50,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 10:56:50,958 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1187683171=5, srv1384285777=18, srv1499899140=22, srv17931338=36, srv486402906=66, srv1354558613=16, srv1739136141=32, srv1142621184=3, srv514839665=70, srv1039735823=1, srv367350340=59, srv792328581=87, srv134303378=15, srv1830893285=39, srv91858150=95, srv497200819=67, srv1831754449=40, srv2046521012=49, srv332960176=57, srv507621037=69, srv646201063=79, srv541895261=74, srv614502517=78, srv1769754342=35, srv17436170=33, srv1493346767=21, srv1505404096=23, srv1698840835=29, srv1278544335=9, srv725044150=82, srv1520751040=24, srv534399026=73, srv806387244=88, srv916963178=94, srv570838946=75, srv371072527=60, srv533537816=72, srv2098407440=51, srv788103839=86, srv1485848098=20, srv251098295=54, srv517578785=71, srv1230088976=8, srv889210940=91, srv1850809639=41, srv122294909=6, srv773162886=83, srv788008917=85, srv851199301=89, srv1338886702=14, srv1703974151=30, srv942910186=98, srv606053997=77, srv957903305=99, srv586641821=76, srv1964624573=47, srv309214960=55, srv1331705210=13, srv1527017398=25, srv455901440=61, srv479575647=63, srv1707660103=31, srv1228988168=7, srv1323962859=10, srv1926118423=44, srv909916015=93, srv1811143300=37, srv715462997=81, srv1962299994=46, srv1916076545=43, srv1972711906=48, srv1430057757=19, srv90425783=92, srv1327444459=12, srv1107741113=2, srv693476281=80, srv1365543949=17, srv1019320115=0, srv1664037161=28, srv344124534=58, srv1558210361=26, srv1747036967=34, srv1929935042=45, srv1146575751=4, srv2092895442=50, srv2121725174=53, srv1890033720=42, srv877035397=90, srv1324784265=11, srv483684930=64, srv2105692420=52, srv484488658=65, srv1828748640=38, srv472733510=62, srv941376199=97, srv1658103945=27, srv780138576=84, srv920762781=96, srv322574472=56, srv503902646=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 10:56:50,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 10:56:50,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 10:56:50,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 10:56:50,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 10:56:50,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 10:56:50,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 10:56:50,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 10:56:50,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 10:56:50,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 10:56:50,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 10:56:50,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 10:56:50,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 10:56:50,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 10:56:50,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 10:56:50,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 10:56:50,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 10:56:50,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 10:56:50,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 10:56:50,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 10:56:50,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 10:56:50,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 10:56:50,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 10:56:50,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 10:56:50,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 10:56:50,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 10:56:50,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 10:56:50,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 10:56:50,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 10:56:50,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 10:56:51,060 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023530512066876966); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03485097341429191, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023530512066876966); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042166666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 10:56:51,060 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 10:56:51,060 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013669325278826925, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023530512066876966); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03485097341429191, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023530512066876966); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042166666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 10:56:51,216 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 229 ms to try 5000 different iterations.  Found a solution that moves 902 regions; Going from a computed imbalance of 0.013669325278826925 to a new imbalance of 7.589418935914133E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006871162160442122); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006513389472789296); MoveCostFunction : (multiplier=7.0, imbalance=0.10022222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006871162160442122); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 10:56:51,219 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1354558613:80 , srv1664037161:82 , srv1831754449:82 , srv533537816:82 , srv780138576:82 , srv1107741113:83 , srv134303378:83 , srv1707660103:83 , srv1769754342:83 , srv1811143300:83 , srv1830893285:83 , srv851199301:83 , srv122294909:84 , srv1493346767:84 , srv1499899140:84 , srv1929935042:84 , srv1972711906:84 , srv2098407440:84 , srv2121725174:84 , srv309214960:84 , srv332960176:84 , srv483684930:84 , srv715462997:84 , srv91858150:84 , srv941376199:84 , srv1146575751:85 , srv1327444459:85 , srv1331705210:85 , srv1384285777:85 , srv1505404096:85 , srv1558210361:85 , srv1703974151:85 , srv1828748640:85 , srv1926118423:85 , srv322574472:85 , srv367350340:85 , srv484488658:85 , srv570838946:85 , srv586641821:85 , srv606053997:85 , srv788103839:85 , srv792328581:85 , srv806387244:85 , srv889210940:85 , srv90425783:85 , srv920762781:85 , srv957903305:85 , srv1142621184:86 , srv1187683171:86 , srv1228988168:86 , srv1230088976:86 , srv1278544335:86 , srv1338886702:86 , srv1430057757:86 , srv1520751040:86 , srv1527017398:86 , srv1658103945:86 , srv1739136141:86 , srv1890033720:86 , srv1962299994:86 , srv1964624573:86 , srv2046521012:86 , srv2092895442:86 , srv2105692420:86 , srv371072527:86 , srv455901440:86 , srv507621037:86 , srv514839665:86 , srv541895261:86 , srv614502517:86 , srv646201063:86 , srv725044150:86 , srv1019320115:87 , srv1039735823:87 , srv1365543949:87 , srv17436170:87 , srv1747036967:87 , srv17931338:87 , srv479575647:87 , srv497200819:87 , srv503902646:87 , srv517578785:87 , srv693476281:87 , srv773162886:87 , srv877035397:87 , srv909916015:87 , srv942910186:87 , srv1323962859:88 , srv1324784265:88 , srv1698840835:88 , srv1916076545:88 , srv251098295:88 , srv344124534:88 , srv472733510:88 , srv486402906:88 , srv534399026:88 , srv788008917:88 , srv1850809639:89 , srv916963178:89 , srv1485848098:536 }
2023-10-27 10:56:51,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 10:56:51,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1187683171=5, srv1384285777=18, srv1499899140=22, srv17931338=36, srv486402906=66, srv1354558613=16, srv1739136141=32, srv1142621184=3, srv514839665=70, srv1039735823=1, srv367350340=59, srv792328581=87, srv134303378=15, srv1830893285=39, srv91858150=95, srv497200819=67, srv1831754449=40, srv2046521012=49, srv332960176=57, srv507621037=69, srv646201063=79, srv541895261=74, srv614502517=78, srv1769754342=35, srv17436170=33, srv1493346767=21, srv1505404096=23, srv1698840835=29, srv1278544335=9, srv725044150=82, srv1520751040=24, srv534399026=73, srv806387244=88, srv916963178=94, srv570838946=75, srv371072527=60, srv533537816=72, srv2098407440=51, srv788103839=86, srv1485848098=20, srv251098295=54, srv517578785=71, srv1230088976=8, srv889210940=91, srv1850809639=41, srv122294909=6, srv773162886=83, srv788008917=85, srv851199301=89, srv1338886702=14, srv1703974151=30, srv942910186=98, srv606053997=77, srv957903305=99, srv586641821=76, srv1964624573=47, srv309214960=55, srv1331705210=13, srv1527017398=25, srv455901440=61, srv479575647=63, srv1707660103=31, srv1228988168=7, srv1323962859=10, srv1926118423=44, srv909916015=93, srv1811143300=37, srv715462997=81, srv1962299994=46, srv1916076545=43, srv1972711906=48, srv1430057757=19, srv90425783=92, srv1327444459=12, srv1107741113=2, srv693476281=80, srv1365543949=17, srv1019320115=0, srv1664037161=28, srv344124534=58, srv1558210361=26, srv1747036967=34, srv1929935042=45, srv1146575751=4, srv2092895442=50, srv2121725174=53, srv1890033720=42, srv877035397=90, srv1324784265=11, srv483684930=64, srv2105692420=52, srv484488658=65, srv1828748640=38, srv472733510=62, srv941376199=97, srv1658103945=27, srv780138576=84, srv920762781=96, srv322574472=56, srv503902646=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 10:56:51,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 10:56:51,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 10:56:51,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 10:56:51,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 10:56:51,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 10:56:51,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 10:56:51,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 10:56:51,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 10:56:51,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 10:56:51,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 10:56:51,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 10:56:51,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 10:56:51,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 10:56:51,318 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006871162160442122); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006513389472789296); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006871162160442122); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 10:56:51,318 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-27 10:56:51,319 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.526259545981423E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006871162160442122); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006513389472789296); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006871162160442122); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-27 10:56:51,540 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 294 ms to try 5000 different iterations.  Found a solution that moves 213 regions; Going from a computed imbalance of 7.526259545981423E-4 to a new imbalance of 1.1332321095088978E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.023666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 10:56:51,541 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1327444459:83 , srv1850809639:83 , srv322574472:83 , srv1019320115:84 , srv1187683171:84 , srv1230088976:84 , srv1278544335:84 , srv1323962859:84 , srv1324784265:84 , srv1365543949:84 , srv1493346767:84 , srv1499899140:84 , srv1664037161:84 , srv1698840835:84 , srv1703974151:84 , srv17931338:84 , srv1811143300:84 , srv1830893285:84 , srv1926118423:84 , srv1929935042:84 , srv2046521012:84 , srv2105692420:84 , srv367350340:84 , srv371072527:84 , srv455901440:84 , srv479575647:84 , srv483684930:84 , srv484488658:84 , srv486402906:84 , srv507621037:84 , srv517578785:84 , srv533537816:84 , srv646201063:84 , srv806387244:84 , srv851199301:84 , srv889210940:84 , srv909916015:84 , srv916963178:84 , srv957903305:84 , srv1107741113:85 , srv1142621184:85 , srv1146575751:85 , srv122294909:85 , srv1228988168:85 , srv1331705210:85 , srv134303378:85 , srv1354558613:85 , srv1384285777:85 , srv1430057757:85 , srv1505404096:85 , srv1520751040:85 , srv1527017398:85 , srv1558210361:85 , srv1658103945:85 , srv1707660103:85 , srv1739136141:85 , srv1747036967:85 , srv1769754342:85 , srv1828748640:85 , srv1831754449:85 , srv1890033720:85 , srv1916076545:85 , srv1962299994:85 , srv1964624573:85 , srv1972711906:85 , srv2092895442:85 , srv2098407440:85 , srv2121725174:85 , srv251098295:85 , srv309214960:85 , srv332960176:85 , srv344124534:85 , srv472733510:85 , srv497200819:85 , srv503902646:85 , srv514839665:85 , srv534399026:85 , srv541895261:85 , srv570838946:85 , srv586641821:85 , srv606053997:85 , srv614502517:85 , srv693476281:85 , srv715462997:85 , srv725044150:85 , srv773162886:85 , srv788008917:85 , srv788103839:85 , srv792328581:85 , srv877035397:85 , srv90425783:85 , srv91858150:85 , srv920762781:85 , srv941376199:85 , srv942910186:85 , srv1039735823:86 , srv1338886702:86 , srv17436170:86 , srv780138576:86 , srv1485848098:623 }
2023-10-27 10:56:51,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 10:56:51,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1187683171=5, srv1384285777=18, srv1499899140=22, srv17931338=36, srv486402906=66, srv1354558613=16, srv1739136141=32, srv1142621184=3, srv514839665=70, srv1039735823=1, srv367350340=59, srv792328581=87, srv134303378=15, srv1830893285=39, srv91858150=95, srv497200819=67, srv1831754449=40, srv2046521012=49, srv332960176=57, srv507621037=69, srv646201063=79, srv541895261=74, srv614502517=78, srv1769754342=35, srv17436170=33, srv1493346767=21, srv1505404096=23, srv1698840835=29, srv1278544335=9, srv725044150=82, srv1520751040=24, srv534399026=73, srv806387244=88, srv916963178=94, srv570838946=75, srv371072527=60, srv533537816=72, srv2098407440=51, srv788103839=86, srv1485848098=20, srv251098295=54, srv517578785=71, srv1230088976=8, srv889210940=91, srv1850809639=41, srv122294909=6, srv773162886=83, srv788008917=85, srv851199301=89, srv1338886702=14, srv1703974151=30, srv942910186=98, srv606053997=77, srv957903305=99, srv586641821=76, srv1964624573=47, srv309214960=55, srv1331705210=13, srv1527017398=25, srv455901440=61, srv479575647=63, srv1707660103=31, srv1228988168=7, srv1323962859=10, srv1926118423=44, srv909916015=93, srv1811143300=37, srv715462997=81, srv1962299994=46, srv1916076545=43, srv1972711906=48, srv1430057757=19, srv90425783=92, srv1327444459=12, srv1107741113=2, srv693476281=80, srv1365543949=17, srv1019320115=0, srv1664037161=28, srv344124534=58, srv1558210361=26, srv1747036967=34, srv1929935042=45, srv1146575751=4, srv2092895442=50, srv2121725174=53, srv1890033720=42, srv877035397=90, srv1324784265=11, srv483684930=64, srv2105692420=52, srv484488658=65, srv1828748640=38, srv472733510=62, srv941376199=97, srv1658103945=27, srv780138576=84, srv920762781=96, srv322574472=56, srv503902646=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 10:56:51,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 10:56:51,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 10:56:51,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 10:56:51,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 10:56:51,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 10:56:51,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 10:56:51,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 10:56:51,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 10:56:51,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 10:56:51,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 10:56:51,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 10:56:51,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 10:56:51,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-27 10:56:51,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-27 10:56:51,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-27 10:56:51,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-27 10:56:51,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-27 10:56:51,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-27 10:56:51,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-27 10:56:51,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-27 10:56:51,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-27 10:56:51,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-27 10:56:51,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-27 10:56:51,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-27 10:56:51,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-27 10:56:51,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-27 10:56:51,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-27 10:56:51,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-27 10:56:51,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-27 10:56:51,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-27 10:56:51,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-27 10:56:51,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-27 10:56:51,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-27 10:56:51,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-27 10:56:51,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-27 10:56:51,636 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=9.840863217520566E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 10:56:51,637 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1327444459:83 , srv1850809639:83 , srv322574472:83 , srv1019320115:84 , srv1187683171:84 , srv1230088976:84 , srv1278544335:84 , srv1323962859:84 , srv1324784265:84 , srv1365543949:84 , srv1493346767:84 , srv1499899140:84 , srv1664037161:84 , srv1698840835:84 , srv1703974151:84 , srv17931338:84 , srv1811143300:84 , srv1830893285:84 , srv1926118423:84 , srv1929935042:84 , srv2046521012:84 , srv2105692420:84 , srv367350340:84 , srv371072527:84 , srv455901440:84 , srv479575647:84 , srv483684930:84 , srv484488658:84 , srv486402906:84 , srv507621037:84 , srv517578785:84 , srv533537816:84 , srv646201063:84 , srv806387244:84 , srv851199301:84 , srv889210940:84 , srv909916015:84 , srv916963178:84 , srv957903305:84 , srv1107741113:85 , srv1142621184:85 , srv1146575751:85 , srv122294909:85 , srv1228988168:85 , srv1331705210:85 , srv134303378:85 , srv1354558613:85 , srv1384285777:85 , srv1430057757:85 , srv1505404096:85 , srv1520751040:85 , srv1527017398:85 , srv1558210361:85 , srv1658103945:85 , srv1707660103:85 , srv1739136141:85 , srv1747036967:85 , srv1769754342:85 , srv1828748640:85 , srv1831754449:85 , srv1890033720:85 , srv1916076545:85 , srv1962299994:85 , srv1964624573:85 , srv1972711906:85 , srv2092895442:85 , srv2098407440:85 , srv2121725174:85 , srv251098295:85 , srv309214960:85 , srv332960176:85 , srv344124534:85 , srv472733510:85 , srv497200819:85 , srv503902646:85 , srv514839665:85 , srv534399026:85 , srv541895261:85 , srv570838946:85 , srv586641821:85 , srv606053997:85 , srv614502517:85 , srv693476281:85 , srv715462997:85 , srv725044150:85 , srv773162886:85 , srv788008917:85 , srv788103839:85 , srv792328581:85 , srv877035397:85 , srv90425783:85 , srv91858150:85 , srv920762781:85 , srv941376199:85 , srv942910186:85 , srv1039735823:86 , srv1338886702:86 , srv17436170:86 , srv780138576:86 , srv1485848098:623 }
2023-10-27 10:56:51,660 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 280), ProcessCount=167 (was 167), AvailableMemoryMB=7631 (was 8101)
2023-10-27 10:56:51,666 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=167, AvailableMemoryMB=7631
2023-10-27 10:56:51,666 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-27 10:56:51,667 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-27 10:56:51,674 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1023308711:84 , srv1023498185:84 , srv1027832942:84 , srv1109749088:84 , srv1141174324:84 , srv1235954640:84 , srv1489113412:84 , srv1506345196:84 , srv1526981181:84 , srv1549527774:84 , srv1553692586:84 , srv1636076863:84 , srv1696920896:84 , srv1800561660:84 , srv182719853:84 , srv2043981029:84 , srv2049473710:84 , srv216792463:84 , srv231280268:84 , srv359166868:84 , srv455638372:84 , srv4688514:84 , srv601357823:84 , srv649178757:84 , srv649489351:84 , srv830556474:84 , srv835849298:84 , srv872614569:84 , srv898450084:84 , srv173335405:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-27 10:56:51,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 10:56:51,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1526981181=8, srv1109749088=3, srv649489351=25, srv1023498185=1, srv1553692586=10, srv649178757=24, srv1235954640=5, srv898450084=29, srv830556474=26, srv231280268=19, srv1636076863=11, srv182719853=15, srv1800561660=14, srv1696920896=12, srv1506345196=7, srv359166868=20, srv1549527774=9, srv601357823=23, srv2043981029=16, srv4688514=22, srv2049473710=17, srv455638372=21, srv1141174324=4, srv1023308711=0, srv835849298=27, srv1027832942=2, srv1489113412=6, srv872614569=28, srv216792463=18, srv173335405=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 10:56:51,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 10:56:51,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 10:56:51,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 10:56:51,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 10:56:51,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 10:56:51,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 10:56:51,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 10:56:51,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 10:56:51,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 10:56:51,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 10:56:51,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 10:56:51,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 10:56:51,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-27 10:56:51,699 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1894099987721116, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 10:56:51,699 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912789867985603, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1894099987721116, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-27 10:58:51,687 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9419646 different iterations.  Found a solution that moves 1836 regions; Going from a computed imbalance of 0.9912789867985603 to a new imbalance of 4.2853155918867096E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.68, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 10:58:51,695 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1023308711:90 , srv1023498185:90 , srv1027832942:90 , srv1109749088:90 , srv1141174324:90 , srv1235954640:90 , srv1489113412:90 , srv1506345196:90 , srv1526981181:90 , srv1549527774:90 , srv1553692586:90 , srv1636076863:90 , srv1696920896:90 , srv173335405:90 , srv1800561660:90 , srv182719853:90 , srv2043981029:90 , srv2049473710:90 , srv216792463:90 , srv231280268:90 , srv359166868:90 , srv455638372:90 , srv4688514:90 , srv601357823:90 , srv649178757:90 , srv649489351:90 , srv830556474:90 , srv835849298:90 , srv872614569:90 , srv898450084:90 }
2023-10-27 10:58:51,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-27 10:58:51,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1526981181=8, srv1109749088=3, srv649489351=25, srv1023498185=1, srv1553692586=10, srv649178757=24, srv1235954640=5, srv898450084=29, srv830556474=26, srv231280268=19, srv1636076863=11, srv182719853=15, srv1800561660=14, srv1696920896=12, srv1506345196=7, srv359166868=20, srv1549527774=9, srv601357823=23, srv2043981029=16, srv4688514=22, srv2049473710=17, srv455638372=21, srv1141174324=4, srv1023308711=0, srv835849298=27, srv1027832942=2, srv1489113412=6, srv872614569=28, srv216792463=18, srv173335405=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-27 10:58:51,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-27 10:58:51,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-27 10:58:51,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-27 10:58:51,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-27 10:58:51,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-27 10:58:51,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-27 10:58:51,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-27 10:58:51,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-27 10:58:51,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-27 10:58:51,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-27 10:58:51,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-27 10:58:51,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-27 10:58:51,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-27 10:58:51,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-27 10:58:51,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-27 10:58:51,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-27 10:58:51,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-27 10:58:51,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-27 10:58:51,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-27 10:58:51,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-27 10:58:51,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-27 10:58:51,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-27 10:58:51,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-27 10:58:51,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-27 10:58:51,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-27 10:58:51,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-27 10:58:51,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-27 10:58:51,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-27 10:58:51,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-27 10:58:51,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-27 10:58:51,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-27 10:58:51,719 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-27 10:58:51,720 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1023308711:90 , srv1023498185:90 , srv1027832942:90 , srv1109749088:90 , srv1141174324:90 , srv1235954640:90 , srv1489113412:90 , srv1506345196:90 , srv1526981181:90 , srv1549527774:90 , srv1553692586:90 , srv1636076863:90 , srv1696920896:90 , srv173335405:90 , srv1800561660:90 , srv182719853:90 , srv2043981029:90 , srv2049473710:90 , srv216792463:90 , srv231280268:90 , srv359166868:90 , srv455638372:90 , srv4688514:90 , srv601357823:90 , srv649178757:90 , srv649489351:90 , srv830556474:90 , srv835849298:90 , srv872614569:90 , srv898450084:90 }
2023-10-27 10:58:51,734 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=275 (was 280), ProcessCount=165 (was 167), AvailableMemoryMB=7769 (was 7631) - AvailableMemoryMB LEAK? -