2023-12-19 20:53:17,371 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-19 20:53:17,720 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-19 20:53:17,844 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-19 20:53:17,914 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-19 20:53:17,921 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-19 20:53:17,935 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=310, ProcessCount=170, AvailableMemoryMB=11332
2023-12-19 20:53:17,937 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-19 20:53:17,938 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-19 20:53:18,080 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1016752354:84 , srv1022697479:84 , srv1039806562:84 , srv107271836:84 , srv1082364167:84 , srv1085959743:84 , srv1088431780:84 , srv1088563730:84 , srv1120505979:84 , srv1128975468:84 , srv113797672:84 , srv1156547409:84 , srv1163804581:84 , srv1173247050:84 , srv1185359133:84 , srv1193435369:84 , srv1194686939:84 , srv1228184156:84 , srv1291300722:84 , srv1313610631:84 , srv1324603289:84 , srv1334711850:84 , srv1337920418:84 , srv1339790585:84 , srv1367541539:84 , srv1410267884:84 , srv1472184278:84 , srv1508288399:84 , srv1537631940:84 , srv1538147361:84 , srv1589712313:84 , srv1591390289:84 , srv1619461435:84 , srv1661721332:84 , srv1689133969:84 , srv16895797:84 , srv1690955695:84 , srv1701108653:84 , srv1759660023:84 , srv1761095532:84 , srv1799531386:84 , srv1844208827:84 , srv1847354445:84 , srv1862492210:84 , srv1915725583:84 , srv1921994745:84 , srv1959667276:84 , srv1995764004:84 , srv2001280943:84 , srv2038715600:84 , srv2049921638:84 , srv2050508047:84 , srv2058739685:84 , srv2086045839:84 , srv2094766043:84 , srv2102528126:84 , srv2126162337:84 , srv227341075:84 , srv231265412:84 , srv288265130:84 , srv321790770:84 , srv333610880:84 , srv348842609:84 , srv375715974:84 , srv381844721:84 , srv391573724:84 , srv397328746:84 , srv409123079:84 , srv430151852:84 , srv432867835:84 , srv449990152:84 , srv480591396:84 , srv512705033:84 , srv513262694:84 , srv549842487:84 , srv559901841:84 , srv561006534:84 , srv584211073:84 , srv634492182:84 , srv650920732:84 , srv656565765:84 , srv658052487:84 , srv683232562:84 , srv69439168:84 , srv696819522:84 , srv714895701:84 , srv716625307:84 , srv720322998:84 , srv725610144:84 , srv800183123:84 , srv810608401:84 , srv832955449:84 , srv839754555:84 , srv860620001:84 , srv87698116:84 , srv93863785:84 , srv943447353:84 , srv946014633:84 , srv99600272:84 , srv197870589:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-19 20:53:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 20:53:18,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1337920418=22, srv1472184278=26, srv480591396=72, srv860620001=94, srv375715974=64, srv2094766043=55, srv1291300722=18, srv1661721332=33, srv2001280943=49, srv231265412=59, srv810608401=91, srv561006534=77, srv1410267884=25, srv658052487=82, srv197870589=47, srv1082364167=4, srv69439168=84, srv2038715600=50, srv1759660023=38, srv1995764004=48, srv113797672=10, srv512705033=73, srv800183123=90, srv1591390289=31, srv409123079=68, srv1228184156=17, srv1538147361=29, srv832955449=92, srv943447353=97, srv348842609=63, srv1537631940=28, srv725610144=89, srv1799531386=40, srv720322998=88, srv1589712313=30, srv1915725583=44, srv2102528126=56, srv321790770=61, srv1039806562=2, srv1088563730=7, srv513262694=74, srv650920732=80, srv1120505979=8, srv16895797=35, srv93863785=96, srv99600272=99, srv1367541539=24, srv1088431780=6, srv1959667276=46, srv714895701=86, srv333610880=62, srv2086045839=54, srv1334711850=21, srv1689133969=34, srv449990152=71, srv288265130=60, srv549842487=75, srv1701108653=37, srv1194686939=16, srv1128975468=9, srv391573724=66, srv1844208827=41, srv683232562=83, srv656565765=81, srv1847354445=42, srv1339790585=23, srv1862492210=43, srv381844721=65, srv696819522=85, srv839754555=93, srv1163804581=12, srv1508288399=27, srv2049921638=51, srv559901841=76, srv1085959743=5, srv1173247050=13, srv1690955695=36, srv1761095532=39, srv716625307=87, srv634492182=79, srv946014633=98, srv2058739685=53, srv87698116=95, srv1022697479=1, srv1619461435=32, srv1324603289=20, srv397328746=67, srv107271836=3, srv2126162337=57, srv1156547409=11, srv584211073=78, srv2050508047=52, srv1313610631=19, srv432867835=70, srv1185359133=14, srv430151852=69, srv1016752354=0, srv227341075=58, srv1921994745=45, srv1193435369=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 20:53:18,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 20:53:18,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 20:53:18,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 20:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 20:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 20:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 20:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 20:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 20:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 20:53:18,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 20:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 20:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 20:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 20:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 20:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 20:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 20:53:18,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 20:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 20:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 20:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 20:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 20:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 20:53:18,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 20:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 20:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 20:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 20:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 20:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 20:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 20:53:18,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 20:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 20:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 20:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 20:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 20:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 20:53:18,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 20:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 20:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 20:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 20:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 20:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 20:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 20:53:18,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 20:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 20:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 20:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 20:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 20:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 20:53:18,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 20:53:18,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 20:53:18,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 20:53:18,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 20:53:18,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 20:53:18,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 20:53:18,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 20:53:18,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 20:53:18,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 20:53:18,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 20:53:18,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 20:53:18,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 20:53:18,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 20:53:18,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 20:53:18,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 20:53:18,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 20:53:18,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 20:53:18,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 20:53:18,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 20:53:18,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 20:53:18,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 20:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 20:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 20:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 20:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 20:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 20:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 20:53:18,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 20:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 20:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 20:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 20:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 20:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 20:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 20:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 20:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 20:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 20:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 20:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 20:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 20:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 20:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 20:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 20:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 20:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 20:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 20:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 20:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 20:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 20:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 20:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 20:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 20:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 20:53:18,597 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:53:18,598 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 20:53:18,598 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 20:53:19,282 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1020 ms to try 5000 different iterations.  Found a solution that moves 4693 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17679019648610628. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03692170595489566, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0528428625804986, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5214444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03692170595489566, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17183333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24041666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:53:19,293 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv69439168:82 , srv1022697479:83 , srv1120505979:83 , srv1995764004:83 , srv409123079:83 , srv800183123:83 , srv1088563730:84 , srv1661721332:84 , srv1799531386:84 , srv1959667276:84 , srv2058739685:84 , srv2102528126:84 , srv480591396:84 , srv650920732:84 , srv720322998:84 , srv725610144:84 , srv839754555:84 , srv93863785:84 , srv99600272:84 , srv1016752354:85 , srv107271836:85 , srv1313610631:85 , srv1508288399:85 , srv1538147361:85 , srv1690955695:85 , srv2038715600:85 , srv2049921638:85 , srv321790770:85 , srv333610880:85 , srv381844721:85 , srv430151852:85 , srv656565765:85 , srv696819522:85 , srv716625307:85 , srv1039806562:86 , srv1088431780:86 , srv113797672:86 , srv1156547409:86 , srv1193435369:86 , srv1291300722:86 , srv1337920418:86 , srv1537631940:86 , srv16895797:86 , srv1701108653:86 , srv1847354445:86 , srv1915725583:86 , srv2050508047:86 , srv2086045839:86 , srv2094766043:86 , srv227341075:86 , srv288265130:86 , srv449990152:86 , srv549842487:86 , srv860620001:86 , srv943447353:86 , srv946014633:86 , srv1082364167:87 , srv1085959743:87 , srv1128975468:87 , srv1163804581:87 , srv1334711850:87 , srv1367541539:87 , srv1472184278:87 , srv1589712313:87 , srv1591390289:87 , srv1921994745:87 , srv231265412:87 , srv513262694:87 , srv561006534:87 , srv658052487:87 , srv1173247050:88 , srv1339790585:88 , srv1689133969:88 , srv1844208827:88 , srv375715974:88 , srv391573724:88 , srv432867835:88 , srv584211073:88 , srv683232562:88 , srv1759660023:89 , srv2001280943:89 , srv559901841:89 , srv634492182:89 , srv87698116:89 , srv1194686939:90 , srv1410267884:90 , srv1619461435:90 , srv1761095532:90 , srv1862492210:90 , srv2126162337:90 , srv397328746:91 , srv512705033:91 , srv810608401:91 , srv1185359133:92 , srv714895701:92 , srv1228184156:93 , srv832955449:93 , srv1324603289:94 , srv348842609:94 , srv197870589:418 }
2023-12-19 20:53:19,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 20:53:19,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1337920418=22, srv1472184278=26, srv480591396=72, srv860620001=94, srv375715974=64, srv2094766043=55, srv1291300722=18, srv1661721332=33, srv2001280943=49, srv231265412=59, srv810608401=91, srv561006534=77, srv1410267884=25, srv658052487=82, srv197870589=47, srv1082364167=4, srv69439168=84, srv2038715600=50, srv1759660023=38, srv1995764004=48, srv113797672=10, srv512705033=73, srv800183123=90, srv1591390289=31, srv409123079=68, srv1228184156=17, srv1538147361=29, srv832955449=92, srv943447353=97, srv348842609=63, srv1537631940=28, srv725610144=89, srv1799531386=40, srv720322998=88, srv1589712313=30, srv1915725583=44, srv2102528126=56, srv321790770=61, srv1039806562=2, srv1088563730=7, srv513262694=74, srv650920732=80, srv1120505979=8, srv16895797=35, srv93863785=96, srv99600272=99, srv1367541539=24, srv1088431780=6, srv1959667276=46, srv714895701=86, srv333610880=62, srv2086045839=54, srv1334711850=21, srv1689133969=34, srv449990152=71, srv288265130=60, srv549842487=75, srv1701108653=37, srv1194686939=16, srv1128975468=9, srv391573724=66, srv1844208827=41, srv683232562=83, srv656565765=81, srv1847354445=42, srv1339790585=23, srv1862492210=43, srv381844721=65, srv696819522=85, srv839754555=93, srv1163804581=12, srv1508288399=27, srv2049921638=51, srv559901841=76, srv1085959743=5, srv1173247050=13, srv1690955695=36, srv1761095532=39, srv716625307=87, srv634492182=79, srv946014633=98, srv2058739685=53, srv87698116=95, srv1022697479=1, srv1619461435=32, srv1324603289=20, srv397328746=67, srv107271836=3, srv2126162337=57, srv1156547409=11, srv584211073=78, srv2050508047=52, srv1313610631=19, srv432867835=70, srv1185359133=14, srv430151852=69, srv1016752354=0, srv227341075=58, srv1921994745=45, srv1193435369=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 20:53:19,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 20:53:19,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 20:53:19,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 20:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 20:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 20:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 20:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 20:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 20:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 20:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 20:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 20:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 20:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 20:53:19,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 20:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 20:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 20:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 20:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 20:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 20:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 20:53:19,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 20:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 20:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 20:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 20:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 20:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 20:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 20:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 20:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 20:53:19,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 20:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 20:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 20:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 20:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 20:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 20:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 20:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 20:53:19,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 20:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 20:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 20:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 20:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 20:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 20:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 20:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 20:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 20:53:19,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 20:53:19,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 20:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 20:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 20:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 20:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 20:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 20:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 20:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 20:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 20:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 20:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 20:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 20:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 20:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 20:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 20:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 20:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 20:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 20:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 20:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 20:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 20:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 20:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 20:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 20:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 20:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 20:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 20:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 20:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 20:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 20:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 20:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 20:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 20:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 20:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 20:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 20:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 20:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 20:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 20:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 20:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 20:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 20:53:19,543 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03692170595489566, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0528428625804986, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03692170595489566, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17183333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24041666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:53:19,543 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 20:53:19,543 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17675733539775218, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03692170595489566, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0528428625804986, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03692170595489566, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17183333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24041666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 20:53:19,819 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 460 ms to try 5000 different iterations.  Found a solution that moves 2665 regions; Going from a computed imbalance of 0.17675733539775218 to a new imbalance of 0.01480972488093122. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0196845049627336); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03149831199938063, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2961111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0196845049627336); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:53:19,827 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv348842609:77 , srv1185359133:80 , srv1228184156:80 , srv1324603289:80 , srv832955449:80 , srv1410267884:81 , srv714895701:81 , srv810608401:81 , srv1619461435:82 , srv2001280943:82 , srv1173247050:83 , srv1194686939:83 , srv1761095532:83 , srv1844208827:83 , srv2126162337:83 , srv375715974:83 , srv391573724:83 , srv397328746:83 , srv512705033:83 , srv584211073:83 , srv87698116:83 , srv1128975468:84 , srv1472184278:84 , srv1591390289:84 , srv1689133969:84 , srv1759660023:84 , srv1915725583:84 , srv1921994745:84 , srv2086045839:84 , srv559901841:84 , srv561006534:84 , srv683232562:84 , srv1039806562:85 , srv1088431780:85 , srv1193435369:85 , srv1291300722:85 , srv1334711850:85 , srv1339790585:85 , srv1367541539:85 , srv1847354445:85 , srv1862492210:85 , srv288265130:85 , srv432867835:85 , srv449990152:85 , srv634492182:85 , srv107271836:86 , srv1082364167:86 , srv1163804581:86 , srv1337920418:86 , srv1508288399:86 , srv1537631940:86 , srv1538147361:86 , srv16895797:86 , srv1701108653:86 , srv2038715600:86 , srv227341075:86 , srv231265412:86 , srv321790770:86 , srv549842487:86 , srv658052487:86 , srv696819522:86 , srv943447353:86 , srv113797672:87 , srv1313610631:87 , srv1589712313:87 , srv1799531386:87 , srv2049921638:87 , srv2050508047:87 , srv333610880:87 , srv381844721:87 , srv430151852:87 , srv513262694:87 , srv716625307:87 , srv725610144:87 , srv99600272:87 , srv1016752354:88 , srv1022697479:88 , srv1085959743:88 , srv1690955695:88 , srv1995764004:88 , srv2094766043:88 , srv650920732:88 , srv656565765:88 , srv720322998:88 , srv800183123:88 , srv860620001:88 , srv946014633:88 , srv1088563730:89 , srv1156547409:89 , srv1661721332:89 , srv1959667276:89 , srv2058739685:89 , srv409123079:89 , srv839754555:89 , srv93863785:89 , srv1120505979:90 , srv480591396:90 , srv2102528126:91 , srv69439168:91 , srv197870589:531 }
2023-12-19 20:53:19,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 20:53:19,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1337920418=22, srv1472184278=26, srv480591396=72, srv860620001=94, srv375715974=64, srv2094766043=55, srv1291300722=18, srv1661721332=33, srv2001280943=49, srv231265412=59, srv810608401=91, srv561006534=77, srv1410267884=25, srv658052487=82, srv197870589=47, srv1082364167=4, srv69439168=84, srv2038715600=50, srv1759660023=38, srv1995764004=48, srv113797672=10, srv512705033=73, srv800183123=90, srv1591390289=31, srv409123079=68, srv1228184156=17, srv1538147361=29, srv832955449=92, srv943447353=97, srv348842609=63, srv1537631940=28, srv725610144=89, srv1799531386=40, srv720322998=88, srv1589712313=30, srv1915725583=44, srv2102528126=56, srv321790770=61, srv1039806562=2, srv1088563730=7, srv513262694=74, srv650920732=80, srv1120505979=8, srv16895797=35, srv93863785=96, srv99600272=99, srv1367541539=24, srv1088431780=6, srv1959667276=46, srv714895701=86, srv333610880=62, srv2086045839=54, srv1334711850=21, srv1689133969=34, srv449990152=71, srv288265130=60, srv549842487=75, srv1701108653=37, srv1194686939=16, srv1128975468=9, srv391573724=66, srv1844208827=41, srv683232562=83, srv656565765=81, srv1847354445=42, srv1339790585=23, srv1862492210=43, srv381844721=65, srv696819522=85, srv839754555=93, srv1163804581=12, srv1508288399=27, srv2049921638=51, srv559901841=76, srv1085959743=5, srv1173247050=13, srv1690955695=36, srv1761095532=39, srv716625307=87, srv634492182=79, srv946014633=98, srv2058739685=53, srv87698116=95, srv1022697479=1, srv1619461435=32, srv1324603289=20, srv397328746=67, srv107271836=3, srv2126162337=57, srv1156547409=11, srv584211073=78, srv2050508047=52, srv1313610631=19, srv432867835=70, srv1185359133=14, srv430151852=69, srv1016752354=0, srv227341075=58, srv1921994745=45, srv1193435369=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 20:53:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 20:53:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 20:53:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 20:53:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 20:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 20:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 20:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 20:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 20:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 20:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 20:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 20:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 20:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 20:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 20:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 20:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 20:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 20:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 20:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 20:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 20:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 20:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 20:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 20:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 20:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 20:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 20:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 20:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 20:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 20:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 20:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 20:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 20:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 20:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 20:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 20:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 20:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 20:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 20:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 20:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 20:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 20:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 20:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 20:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 20:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 20:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 20:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 20:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 20:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 20:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 20:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 20:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 20:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 20:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 20:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 20:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 20:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 20:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 20:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 20:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 20:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 20:53:19,992 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0196845049627336); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03149831199938063, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0196845049627336); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:53:19,993 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 20:53:19,993 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014791064152087464, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0196845049627336); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03149831199938063, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0196845049627336); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043333333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 20:53:20,244 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 359 ms to try 5000 different iterations.  Found a solution that moves 955 regions; Going from a computed imbalance of 0.014791064152087464 to a new imbalance of 6.139934335553186E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004974056649863807); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009593301067138396); MoveCostFunction : (multiplier=7.0, imbalance=0.10611111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004974056649863807); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:53:20,246 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1085959743:82 , srv2102528126:82 , srv1156547409:83 , srv1862492210:83 , srv2094766043:83 , srv480591396:83 , srv512705033:83 , srv1016752354:84 , srv1163804581:84 , srv1194686939:84 , srv1228184156:84 , srv1324603289:84 , srv1589712313:84 , srv1661721332:84 , srv1690955695:84 , srv2050508047:84 , srv231265412:84 , srv397328746:84 , srv432867835:84 , srv513262694:84 , srv634492182:84 , srv658052487:84 , srv832955449:84 , srv93863785:84 , srv946014633:84 , srv1082364167:85 , srv1088563730:85 , srv1120505979:85 , srv113797672:85 , srv1313610631:85 , srv1337920418:85 , srv1339790585:85 , srv1367541539:85 , srv1537631940:85 , srv1619461435:85 , srv16895797:85 , srv1759660023:85 , srv1761095532:85 , srv1959667276:85 , srv2049921638:85 , srv2058739685:85 , srv2126162337:85 , srv227341075:85 , srv381844721:85 , srv409123079:85 , srv430151852:85 , srv549842487:85 , srv559901841:85 , srv650920732:85 , srv656565765:85 , srv683232562:85 , srv69439168:85 , srv714895701:85 , srv810608401:85 , srv839754555:85 , srv860620001:85 , srv107271836:86 , srv1088431780:86 , srv1128975468:86 , srv1185359133:86 , srv1193435369:86 , srv1334711850:86 , srv1689133969:86 , srv1701108653:86 , srv1799531386:86 , srv1844208827:86 , srv2001280943:86 , srv321790770:86 , srv333610880:86 , srv348842609:86 , srv375715974:86 , srv391573724:86 , srv449990152:86 , srv696819522:86 , srv716625307:86 , srv720322998:86 , srv725610144:86 , srv87698116:86 , srv943447353:86 , srv1022697479:87 , srv1173247050:87 , srv1291300722:87 , srv1410267884:87 , srv1472184278:87 , srv1508288399:87 , srv1538147361:87 , srv1591390289:87 , srv1847354445:87 , srv1921994745:87 , srv1995764004:87 , srv2038715600:87 , srv288265130:87 , srv561006534:87 , srv584211073:87 , srv800183123:87 , srv99600272:87 , srv1039806562:88 , srv1915725583:88 , srv2086045839:88 , srv197870589:553 }
2023-12-19 20:53:20,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 20:53:20,251 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1337920418=22, srv1472184278=26, srv480591396=72, srv860620001=94, srv375715974=64, srv2094766043=55, srv1291300722=18, srv1661721332=33, srv2001280943=49, srv231265412=59, srv810608401=91, srv561006534=77, srv1410267884=25, srv658052487=82, srv197870589=47, srv1082364167=4, srv69439168=84, srv2038715600=50, srv1759660023=38, srv1995764004=48, srv113797672=10, srv512705033=73, srv800183123=90, srv1591390289=31, srv409123079=68, srv1228184156=17, srv1538147361=29, srv832955449=92, srv943447353=97, srv348842609=63, srv1537631940=28, srv725610144=89, srv1799531386=40, srv720322998=88, srv1589712313=30, srv1915725583=44, srv2102528126=56, srv321790770=61, srv1039806562=2, srv1088563730=7, srv513262694=74, srv650920732=80, srv1120505979=8, srv16895797=35, srv93863785=96, srv99600272=99, srv1367541539=24, srv1088431780=6, srv1959667276=46, srv714895701=86, srv333610880=62, srv2086045839=54, srv1334711850=21, srv1689133969=34, srv449990152=71, srv288265130=60, srv549842487=75, srv1701108653=37, srv1194686939=16, srv1128975468=9, srv391573724=66, srv1844208827=41, srv683232562=83, srv656565765=81, srv1847354445=42, srv1339790585=23, srv1862492210=43, srv381844721=65, srv696819522=85, srv839754555=93, srv1163804581=12, srv1508288399=27, srv2049921638=51, srv559901841=76, srv1085959743=5, srv1173247050=13, srv1690955695=36, srv1761095532=39, srv716625307=87, srv634492182=79, srv946014633=98, srv2058739685=53, srv87698116=95, srv1022697479=1, srv1619461435=32, srv1324603289=20, srv397328746=67, srv107271836=3, srv2126162337=57, srv1156547409=11, srv584211073=78, srv2050508047=52, srv1313610631=19, srv432867835=70, srv1185359133=14, srv430151852=69, srv1016752354=0, srv227341075=58, srv1921994745=45, srv1193435369=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 20:53:20,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 20:53:20,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 20:53:20,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 20:53:20,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 20:53:20,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 20:53:20,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 20:53:20,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 20:53:20,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 20:53:20,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 20:53:20,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 20:53:20,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 20:53:20,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 20:53:20,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 20:53:20,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 20:53:20,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 20:53:20,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 20:53:20,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 20:53:20,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 20:53:20,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 20:53:20,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 20:53:20,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 20:53:20,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 20:53:20,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 20:53:20,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 20:53:20,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 20:53:20,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 20:53:20,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 20:53:20,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 20:53:20,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 20:53:20,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 20:53:20,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 20:53:20,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 20:53:20,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 20:53:20,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 20:53:20,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 20:53:20,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 20:53:20,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 20:53:20,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 20:53:20,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 20:53:20,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 20:53:20,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 20:53:20,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 20:53:20,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 20:53:20,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 20:53:20,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 20:53:20,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 20:53:20,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 20:53:20,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 20:53:20,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 20:53:20,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 20:53:20,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 20:53:20,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 20:53:20,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 20:53:20,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 20:53:20,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 20:53:20,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 20:53:20,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 20:53:20,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 20:53:20,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 20:53:20,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 20:53:20,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 20:53:20,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 20:53:20,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 20:53:20,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 20:53:20,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 20:53:20,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 20:53:20,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 20:53:20,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 20:53:20,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 20:53:20,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 20:53:20,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 20:53:20,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 20:53:20,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 20:53:20,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 20:53:20,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 20:53:20,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 20:53:20,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 20:53:20,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 20:53:20,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 20:53:20,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 20:53:20,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 20:53:20,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 20:53:20,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 20:53:20,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 20:53:20,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 20:53:20,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 20:53:20,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 20:53:20,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 20:53:20,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 20:53:20,379 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004974056649863807); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009593301067138396); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004974056649863807); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:53:20,379 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 20:53:20,379 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.073063806300705E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004974056649863807); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009593301067138396); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004974056649863807); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 20:53:20,763 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 481 ms to try 5000 different iterations.  Found a solution that moves 199 regions; Going from a computed imbalance of 6.073063806300705E-4 to a new imbalance of 2.5695207734427987E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=2.735366466207394E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.022111111111111113); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=2.735366466207394E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:53:20,763 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1039806562:83 , srv716625307:83 , srv860620001:83 , srv1022697479:84 , srv1082364167:84 , srv1088563730:84 , srv1120505979:84 , srv113797672:84 , srv1156547409:84 , srv1173247050:84 , srv1185359133:84 , srv1291300722:84 , srv1324603289:84 , srv1334711850:84 , srv1339790585:84 , srv1410267884:84 , srv1472184278:84 , srv1508288399:84 , srv1538147361:84 , srv1589712313:84 , srv1591390289:84 , srv1689133969:84 , srv1701108653:84 , srv1759660023:84 , srv1761095532:84 , srv1847354445:84 , srv1862492210:84 , srv1915725583:84 , srv1921994745:84 , srv1959667276:84 , srv2038715600:84 , srv2058739685:84 , srv2086045839:84 , srv2126162337:84 , srv288265130:84 , srv333610880:84 , srv397328746:84 , srv449990152:84 , srv513262694:84 , srv549842487:84 , srv559901841:84 , srv561006534:84 , srv584211073:84 , srv634492182:84 , srv656565765:84 , srv69439168:84 , srv714895701:84 , srv720322998:84 , srv800183123:84 , srv87698116:84 , srv943447353:84 , srv946014633:84 , srv99600272:84 , srv1016752354:85 , srv107271836:85 , srv1085959743:85 , srv1088431780:85 , srv1128975468:85 , srv1163804581:85 , srv1193435369:85 , srv1194686939:85 , srv1228184156:85 , srv1313610631:85 , srv1337920418:85 , srv1367541539:85 , srv1537631940:85 , srv1619461435:85 , srv1661721332:85 , srv16895797:85 , srv1690955695:85 , srv1799531386:85 , srv1844208827:85 , srv1995764004:85 , srv2001280943:85 , srv2049921638:85 , srv2050508047:85 , srv2094766043:85 , srv2102528126:85 , srv227341075:85 , srv321790770:85 , srv348842609:85 , srv375715974:85 , srv381844721:85 , srv391573724:85 , srv409123079:85 , srv430151852:85 , srv432867835:85 , srv480591396:85 , srv512705033:85 , srv650920732:85 , srv658052487:85 , srv683232562:85 , srv696819522:85 , srv725610144:85 , srv810608401:85 , srv832955449:85 , srv839754555:85 , srv93863785:85 , srv231265412:86 , srv197870589:640 }
2023-12-19 20:53:20,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 20:53:20,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1337920418=22, srv1472184278=26, srv480591396=72, srv860620001=94, srv375715974=64, srv2094766043=55, srv1291300722=18, srv1661721332=33, srv2001280943=49, srv231265412=59, srv810608401=91, srv561006534=77, srv1410267884=25, srv658052487=82, srv197870589=47, srv1082364167=4, srv69439168=84, srv2038715600=50, srv1759660023=38, srv1995764004=48, srv113797672=10, srv512705033=73, srv800183123=90, srv1591390289=31, srv409123079=68, srv1228184156=17, srv1538147361=29, srv832955449=92, srv943447353=97, srv348842609=63, srv1537631940=28, srv725610144=89, srv1799531386=40, srv720322998=88, srv1589712313=30, srv1915725583=44, srv2102528126=56, srv321790770=61, srv1039806562=2, srv1088563730=7, srv513262694=74, srv650920732=80, srv1120505979=8, srv16895797=35, srv93863785=96, srv99600272=99, srv1367541539=24, srv1088431780=6, srv1959667276=46, srv714895701=86, srv333610880=62, srv2086045839=54, srv1334711850=21, srv1689133969=34, srv449990152=71, srv288265130=60, srv549842487=75, srv1701108653=37, srv1194686939=16, srv1128975468=9, srv391573724=66, srv1844208827=41, srv683232562=83, srv656565765=81, srv1847354445=42, srv1339790585=23, srv1862492210=43, srv381844721=65, srv696819522=85, srv839754555=93, srv1163804581=12, srv1508288399=27, srv2049921638=51, srv559901841=76, srv1085959743=5, srv1173247050=13, srv1690955695=36, srv1761095532=39, srv716625307=87, srv634492182=79, srv946014633=98, srv2058739685=53, srv87698116=95, srv1022697479=1, srv1619461435=32, srv1324603289=20, srv397328746=67, srv107271836=3, srv2126162337=57, srv1156547409=11, srv584211073=78, srv2050508047=52, srv1313610631=19, srv432867835=70, srv1185359133=14, srv430151852=69, srv1016752354=0, srv227341075=58, srv1921994745=45, srv1193435369=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 20:53:20,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 20:53:20,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 20:53:20,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 20:53:20,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 20:53:20,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 20:53:20,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 20:53:20,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 20:53:20,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 20:53:20,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 20:53:20,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 20:53:20,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 20:53:20,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 20:53:20,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 20:53:20,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 20:53:20,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 20:53:20,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 20:53:20,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 20:53:20,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 20:53:20,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 20:53:20,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 20:53:20,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 20:53:20,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 20:53:20,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 20:53:20,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 20:53:20,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 20:53:20,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 20:53:20,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 20:53:20,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 20:53:20,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 20:53:20,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 20:53:20,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 20:53:20,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 20:53:20,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 20:53:20,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 20:53:20,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 20:53:20,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 20:53:20,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 20:53:20,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 20:53:20,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 20:53:20,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 20:53:20,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 20:53:20,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 20:53:20,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 20:53:20,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 20:53:20,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 20:53:20,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 20:53:20,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 20:53:20,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 20:53:20,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 20:53:20,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 20:53:20,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 20:53:20,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 20:53:20,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 20:53:20,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 20:53:20,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 20:53:20,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 20:53:20,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 20:53:20,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 20:53:20,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 20:53:20,893 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=2.735366466207394E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=2.735366466207394E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:53:20,893 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 20:53:20,894 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.430177995209881E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=2.735366466207394E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=2.735366466207394E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 20:53:21,139 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 342 ms to try 5000 different iterations.  Found a solution that moves 19 regions; Going from a computed imbalance of 2.430177995209881E-5 to a new imbalance of 6.531026515808665E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.002111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:53:21,140 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1995764004:83 , srv231265412:83 , srv839754555:83 , srv1016752354:84 , srv1022697479:84 , srv1039806562:84 , srv107271836:84 , srv1082364167:84 , srv1085959743:84 , srv1088431780:84 , srv1088563730:84 , srv1120505979:84 , srv1128975468:84 , srv113797672:84 , srv1156547409:84 , srv1163804581:84 , srv1173247050:84 , srv1185359133:84 , srv1193435369:84 , srv1194686939:84 , srv1228184156:84 , srv1291300722:84 , srv1313610631:84 , srv1324603289:84 , srv1334711850:84 , srv1337920418:84 , srv1339790585:84 , srv1367541539:84 , srv1410267884:84 , srv1472184278:84 , srv1508288399:84 , srv1537631940:84 , srv1538147361:84 , srv1589712313:84 , srv1591390289:84 , srv1619461435:84 , srv1661721332:84 , srv1689133969:84 , srv16895797:84 , srv1690955695:84 , srv1701108653:84 , srv1759660023:84 , srv1761095532:84 , srv1799531386:84 , srv1844208827:84 , srv1847354445:84 , srv1862492210:84 , srv1915725583:84 , srv1921994745:84 , srv1959667276:84 , srv2001280943:84 , srv2038715600:84 , srv2049921638:84 , srv2050508047:84 , srv2058739685:84 , srv2086045839:84 , srv2094766043:84 , srv2102528126:84 , srv2126162337:84 , srv227341075:84 , srv288265130:84 , srv321790770:84 , srv333610880:84 , srv348842609:84 , srv375715974:84 , srv381844721:84 , srv391573724:84 , srv397328746:84 , srv409123079:84 , srv430151852:84 , srv432867835:84 , srv480591396:84 , srv512705033:84 , srv513262694:84 , srv559901841:84 , srv561006534:84 , srv584211073:84 , srv634492182:84 , srv650920732:84 , srv656565765:84 , srv658052487:84 , srv683232562:84 , srv69439168:84 , srv696819522:84 , srv714895701:84 , srv720322998:84 , srv725610144:84 , srv800183123:84 , srv810608401:84 , srv832955449:84 , srv860620001:84 , srv87698116:84 , srv93863785:84 , srv943447353:84 , srv946014633:84 , srv99600272:84 , srv449990152:85 , srv549842487:85 , srv716625307:85 , srv197870589:684 }
2023-12-19 20:53:21,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 20:53:21,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1337920418=22, srv1472184278=26, srv480591396=72, srv860620001=94, srv375715974=64, srv2094766043=55, srv1291300722=18, srv1661721332=33, srv2001280943=49, srv231265412=59, srv810608401=91, srv561006534=77, srv1410267884=25, srv658052487=82, srv197870589=47, srv1082364167=4, srv69439168=84, srv2038715600=50, srv1759660023=38, srv1995764004=48, srv113797672=10, srv512705033=73, srv800183123=90, srv1591390289=31, srv409123079=68, srv1228184156=17, srv1538147361=29, srv832955449=92, srv943447353=97, srv348842609=63, srv1537631940=28, srv725610144=89, srv1799531386=40, srv720322998=88, srv1589712313=30, srv1915725583=44, srv2102528126=56, srv321790770=61, srv1039806562=2, srv1088563730=7, srv513262694=74, srv650920732=80, srv1120505979=8, srv16895797=35, srv93863785=96, srv99600272=99, srv1367541539=24, srv1088431780=6, srv1959667276=46, srv714895701=86, srv333610880=62, srv2086045839=54, srv1334711850=21, srv1689133969=34, srv449990152=71, srv288265130=60, srv549842487=75, srv1701108653=37, srv1194686939=16, srv1128975468=9, srv391573724=66, srv1844208827=41, srv683232562=83, srv656565765=81, srv1847354445=42, srv1339790585=23, srv1862492210=43, srv381844721=65, srv696819522=85, srv839754555=93, srv1163804581=12, srv1508288399=27, srv2049921638=51, srv559901841=76, srv1085959743=5, srv1173247050=13, srv1690955695=36, srv1761095532=39, srv716625307=87, srv634492182=79, srv946014633=98, srv2058739685=53, srv87698116=95, srv1022697479=1, srv1619461435=32, srv1324603289=20, srv397328746=67, srv107271836=3, srv2126162337=57, srv1156547409=11, srv584211073=78, srv2050508047=52, srv1313610631=19, srv432867835=70, srv1185359133=14, srv430151852=69, srv1016752354=0, srv227341075=58, srv1921994745=45, srv1193435369=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 20:53:21,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 20:53:21,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 20:53:21,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 20:53:21,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 20:53:21,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 20:53:21,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 20:53:21,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 20:53:21,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 20:53:21,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 20:53:21,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 20:53:21,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 20:53:21,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 20:53:21,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 20:53:21,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 20:53:21,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 20:53:21,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 20:53:21,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 20:53:21,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 20:53:21,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 20:53:21,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 20:53:21,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 20:53:21,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 20:53:21,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 20:53:21,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 20:53:21,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 20:53:21,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 20:53:21,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 20:53:21,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 20:53:21,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 20:53:21,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 20:53:21,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 20:53:21,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 20:53:21,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 20:53:21,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 20:53:21,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 20:53:21,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 20:53:21,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 20:53:21,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 20:53:21,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 20:53:21,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 20:53:21,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 20:53:21,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 20:53:21,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 20:53:21,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 20:53:21,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 20:53:21,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 20:53:21,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 20:53:21,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 20:53:21,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 20:53:21,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 20:53:21,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 20:53:21,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 20:53:21,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 20:53:21,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 20:53:21,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 20:53:21,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 20:53:21,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 20:53:21,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 20:53:21,298 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:53:21,299 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1995764004:83 , srv231265412:83 , srv839754555:83 , srv1016752354:84 , srv1022697479:84 , srv1039806562:84 , srv107271836:84 , srv1082364167:84 , srv1085959743:84 , srv1088431780:84 , srv1088563730:84 , srv1120505979:84 , srv1128975468:84 , srv113797672:84 , srv1156547409:84 , srv1163804581:84 , srv1173247050:84 , srv1185359133:84 , srv1193435369:84 , srv1194686939:84 , srv1228184156:84 , srv1291300722:84 , srv1313610631:84 , srv1324603289:84 , srv1334711850:84 , srv1337920418:84 , srv1339790585:84 , srv1367541539:84 , srv1410267884:84 , srv1472184278:84 , srv1508288399:84 , srv1537631940:84 , srv1538147361:84 , srv1589712313:84 , srv1591390289:84 , srv1619461435:84 , srv1661721332:84 , srv1689133969:84 , srv16895797:84 , srv1690955695:84 , srv1701108653:84 , srv1759660023:84 , srv1761095532:84 , srv1799531386:84 , srv1844208827:84 , srv1847354445:84 , srv1862492210:84 , srv1915725583:84 , srv1921994745:84 , srv1959667276:84 , srv2001280943:84 , srv2038715600:84 , srv2049921638:84 , srv2050508047:84 , srv2058739685:84 , srv2086045839:84 , srv2094766043:84 , srv2102528126:84 , srv2126162337:84 , srv227341075:84 , srv288265130:84 , srv321790770:84 , srv333610880:84 , srv348842609:84 , srv375715974:84 , srv381844721:84 , srv391573724:84 , srv397328746:84 , srv409123079:84 , srv430151852:84 , srv432867835:84 , srv480591396:84 , srv512705033:84 , srv513262694:84 , srv559901841:84 , srv561006534:84 , srv584211073:84 , srv634492182:84 , srv650920732:84 , srv656565765:84 , srv658052487:84 , srv683232562:84 , srv69439168:84 , srv696819522:84 , srv714895701:84 , srv720322998:84 , srv725610144:84 , srv800183123:84 , srv810608401:84 , srv832955449:84 , srv860620001:84 , srv87698116:84 , srv93863785:84 , srv943447353:84 , srv946014633:84 , srv99600272:84 , srv449990152:85 , srv549842487:85 , srv716625307:85 , srv197870589:684 }
2023-12-19 20:53:21,323 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=349 (was 310) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=10725 (was 11332)
2023-12-19 20:53:21,332 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=349, ProcessCount=172, AvailableMemoryMB=10724
2023-12-19 20:53:21,333 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-19 20:53:21,333 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-19 20:53:21,344 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1169252456:84 , srv1170655706:84 , srv1351585769:84 , srv1371500501:84 , srv1577446400:84 , srv1687193201:84 , srv1718375024:84 , srv1763043676:84 , srv1791604476:84 , srv1968464199:84 , srv1991958815:84 , srv2068064019:84 , srv2074459547:84 , srv2097465286:84 , srv2136721924:84 , srv279192452:84 , srv335817328:84 , srv413597803:84 , srv427206999:84 , srv530511850:84 , srv575273617:84 , srv595808714:84 , srv708594614:84 , srv71009064:84 , srv774077140:84 , srv780168841:84 , srv907665469:84 , srv969456051:84 , srv988852486:84 , srv1417024305:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-19 20:53:21,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 20:53:21,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv969456051=28, srv2068064019=12, srv708594614=23, srv2097465286=14, srv1718375024=7, srv2074459547=13, srv413597803=18, srv595808714=22, srv1687193201=6, srv1968464199=10, srv335817328=17, srv1351585769=2, srv1577446400=5, srv1991958815=11, srv279192452=16, srv1169252456=0, srv1371500501=3, srv427206999=19, srv1170655706=1, srv907665469=27, srv780168841=26, srv2136721924=15, srv575273617=21, srv1417024305=4, srv530511850=20, srv71009064=24, srv988852486=29, srv1791604476=9, srv774077140=25, srv1763043676=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 20:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 20:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 20:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 20:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 20:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 20:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 20:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 20:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 20:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 20:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 20:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 20:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 20:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-19 20:53:21,373 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1809395910793261, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:53:21,374 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912763178007549, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1809395910793261, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-19 20:55:21,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5568865 different iterations.  Found a solution that moves 1862 regions; Going from a computed imbalance of 0.9912763178007549 to a new imbalance of 4.346000888939571E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6896296296296296, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:55:21,367 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1169252456:90 , srv1170655706:90 , srv1351585769:90 , srv1371500501:90 , srv1417024305:90 , srv1577446400:90 , srv1687193201:90 , srv1718375024:90 , srv1763043676:90 , srv1791604476:90 , srv1968464199:90 , srv1991958815:90 , srv2068064019:90 , srv2074459547:90 , srv2097465286:90 , srv2136721924:90 , srv279192452:90 , srv335817328:90 , srv413597803:90 , srv427206999:90 , srv530511850:90 , srv575273617:90 , srv595808714:90 , srv708594614:90 , srv71009064:90 , srv774077140:90 , srv780168841:90 , srv907665469:90 , srv969456051:90 , srv988852486:90 }
2023-12-19 20:55:21,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 20:55:21,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv969456051=28, srv2068064019=12, srv708594614=23, srv2097465286=14, srv1718375024=7, srv2074459547=13, srv413597803=18, srv595808714=22, srv1687193201=6, srv1968464199=10, srv335817328=17, srv1351585769=2, srv1577446400=5, srv1991958815=11, srv279192452=16, srv1169252456=0, srv1371500501=3, srv427206999=19, srv1170655706=1, srv907665469=27, srv780168841=26, srv2136721924=15, srv575273617=21, srv1417024305=4, srv530511850=20, srv71009064=24, srv988852486=29, srv1791604476=9, srv774077140=25, srv1763043676=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 20:55:21,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 20:55:21,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 20:55:21,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 20:55:21,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 20:55:21,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 20:55:21,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 20:55:21,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 20:55:21,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 20:55:21,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 20:55:21,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-19 20:55:21,384 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 20:55:21,384 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1169252456:90 , srv1170655706:90 , srv1351585769:90 , srv1371500501:90 , srv1417024305:90 , srv1577446400:90 , srv1687193201:90 , srv1718375024:90 , srv1763043676:90 , srv1791604476:90 , srv1968464199:90 , srv1991958815:90 , srv2068064019:90 , srv2074459547:90 , srv2097465286:90 , srv2136721924:90 , srv279192452:90 , srv335817328:90 , srv413597803:90 , srv427206999:90 , srv530511850:90 , srv575273617:90 , srv595808714:90 , srv708594614:90 , srv71009064:90 , srv774077140:90 , srv780168841:90 , srv907665469:90 , srv969456051:90 , srv988852486:90 }
2023-12-19 20:55:21,396 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=211 (was 349), ProcessCount=169 (was 172), AvailableMemoryMB=9802 (was 10724)