2023-12-19 08:53:17,873 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-19 08:53:18,199 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-19 08:53:18,313 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-19 08:53:18,387 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-19 08:53:18,394 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-19 08:53:18,408 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=270, ProcessCount=171, AvailableMemoryMB=3779
2023-12-19 08:53:18,410 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-19 08:53:18,411 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-19 08:53:18,535 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv102743417:84 , srv1030454127:84 , srv1036949337:84 , srv1041509480:84 , srv1056183470:84 , srv1063014308:84 , srv1064492877:84 , srv1072479306:84 , srv1076217462:84 , srv1082985407:84 , srv1085450229:84 , srv1088923992:84 , srv1095237602:84 , srv1130385530:84 , srv1232921944:84 , srv1237563329:84 , srv1254205113:84 , srv13175002:84 , srv1330095782:84 , srv1347373722:84 , srv1347528864:84 , srv1437013581:84 , srv144395226:84 , srv145840923:84 , srv146207618:84 , srv149146822:84 , srv1567742960:84 , srv1575768022:84 , srv1605196217:84 , srv1609285031:84 , srv1631928099:84 , srv1701298576:84 , srv1706683212:84 , srv1707707133:84 , srv1715910266:84 , srv1716066545:84 , srv1728560918:84 , srv1740047702:84 , srv1792075913:84 , srv1822005815:84 , srv182688366:84 , srv1838056171:84 , srv1839504005:84 , srv1846872242:84 , srv1906552381:84 , srv1921482997:84 , srv1934050625:84 , srv1944407749:84 , srv1954877855:84 , srv19565653:84 , srv1994575146:84 , srv2021332841:84 , srv2074609934:84 , srv2082463476:84 , srv2092577716:84 , srv2094397770:84 , srv2097606458:84 , srv2115549121:84 , srv2130050830:84 , srv218838202:84 , srv233574079:84 , srv276664614:84 , srv301533848:84 , srv304002477:84 , srv312136764:84 , srv340085249:84 , srv368837380:84 , srv384144968:84 , srv409916443:84 , srv410009523:84 , srv411717100:84 , srv437495540:84 , srv444825425:84 , srv453156320:84 , srv458974766:84 , srv460453999:84 , srv50150982:84 , srv522609250:84 , srv53892923:84 , srv544840652:84 , srv626339278:84 , srv627747083:84 , srv639130977:84 , srv644134011:84 , srv651007269:84 , srv667643400:84 , srv690856059:84 , srv695442170:84 , srv707913180:84 , srv707960131:84 , srv73682866:84 , srv770959284:84 , srv812550658:84 , srv832461170:84 , srv865231835:84 , srv898494655:84 , srv908830917:84 , srv910882263:84 , srv931012441:84 , srv1451116855:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-19 08:53:18,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 08:53:18,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv304002477=64, srv667643400=86, srv1232921944=14, srv1631928099=31, srv410009523=70, srv522609250=78, srv1130385530=13, srv544840652=80, srv437495540=72, srv626339278=81, srv1095237602=12, srv53892923=79, srv770959284=92, srv1706683212=33, srv1921482997=46, srv707913180=89, srv1237563329=15, srv149146822=26, srv13175002=17, srv1715910266=35, srv218838202=60, srv1605196217=29, srv2130050830=59, srv1064492877=6, srv639130977=83, srv910882263=98, srv1792075913=39, srv1437013581=21, srv411717100=71, srv898494655=96, srv2092577716=55, srv908830917=97, srv1740047702=38, srv1839504005=43, srv2074609934=53, srv146207618=25, srv1076217462=8, srv1707707133=34, srv233574079=61, srv50150982=77, srv145840923=24, srv301533848=63, srv1944407749=48, srv312136764=65, srv182688366=41, srv695442170=88, srv1934050625=47, srv384144968=68, srv1030454127=1, srv1716066545=36, srv690856059=87, srv1451116855=23, srv460453999=76, srv1906552381=45, srv707960131=90, srv73682866=91, srv453156320=74, srv1567742960=27, srv276664614=62, srv931012441=99, srv340085249=66, srv2021332841=52, srv2097606458=57, srv1082985407=9, srv1822005815=40, srv1330095782=18, srv627747083=82, srv644134011=84, srv832461170=94, srv812550658=93, srv1085450229=10, srv1954877855=49, srv1041509480=3, srv1575768022=28, srv1347373722=19, srv1728560918=37, srv409916443=69, srv1063014308=5, srv1838056171=42, srv2094397770=56, srv102743417=0, srv368837380=67, srv651007269=85, srv1994575146=51, srv19565653=50, srv2082463476=54, srv1347528864=20, srv458974766=75, srv1056183470=4, srv1072479306=7, srv1088923992=11, srv2115549121=58, srv1254205113=16, srv865231835=95, srv444825425=73, srv1846872242=44, srv144395226=22, srv1036949337=2, srv1609285031=30, srv1701298576=32} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 08:53:18,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 08:53:18,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 08:53:18,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 08:53:18,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 08:53:18,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 08:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 08:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 08:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 08:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 08:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 08:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 08:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 08:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 08:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 08:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 08:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 08:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 08:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 08:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 08:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 08:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 08:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 08:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 08:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 08:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 08:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 08:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 08:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 08:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 08:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 08:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 08:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 08:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 08:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 08:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 08:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 08:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 08:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 08:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 08:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 08:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 08:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 08:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 08:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 08:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 08:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 08:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 08:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 08:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 08:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 08:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 08:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 08:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 08:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 08:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 08:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 08:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 08:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 08:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 08:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 08:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 08:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 08:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 08:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 08:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 08:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 08:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 08:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 08:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 08:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 08:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 08:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 08:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 08:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 08:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 08:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 08:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 08:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 08:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 08:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 08:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 08:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 08:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 08:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 08:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 08:53:18,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 08:53:19,002 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:53:19,002 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 08:53:19,002 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 08:53:19,808 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1121 ms to try 5000 different iterations.  Found a solution that moves 4685 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1790102750797996. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042434929977611176, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053488830557307264, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5205555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042434929977611176, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17433333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:53:19,821 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv146207618:81 , srv144395226:82 , srv1706683212:82 , srv1954877855:82 , srv368837380:82 , srv458974766:82 , srv1063014308:83 , srv1095237602:83 , srv1605196217:83 , srv1994575146:83 , srv233574079:83 , srv312136764:83 , srv707913180:83 , srv908830917:83 , srv102743417:84 , srv1347528864:84 , srv1437013581:84 , srv149146822:84 , srv1716066545:84 , srv1728560918:84 , srv1792075913:84 , srv1822005815:84 , srv1846872242:84 , srv2074609934:84 , srv409916443:84 , srv444825425:84 , srv50150982:84 , srv53892923:84 , srv690856059:84 , srv812550658:84 , srv1130385530:85 , srv1347373722:85 , srv1921482997:85 , srv19565653:85 , srv2021332841:85 , srv2094397770:85 , srv2115549121:85 , srv301533848:85 , srv410009523:85 , srv522609250:85 , srv627747083:85 , srv651007269:85 , srv707960131:85 , srv1064492877:86 , srv1082985407:86 , srv1088923992:86 , srv1254205113:86 , srv1330095782:86 , srv1575768022:86 , srv1701298576:86 , srv1707707133:86 , srv1740047702:86 , srv1944407749:86 , srv437495540:86 , srv453156320:86 , srv460453999:86 , srv544840652:86 , srv865231835:86 , srv931012441:86 , srv1056183470:87 , srv1076217462:87 , srv1232921944:87 , srv1237563329:87 , srv145840923:87 , srv1715910266:87 , srv182688366:87 , srv1839504005:87 , srv1906552381:87 , srv2082463476:87 , srv2092577716:87 , srv276664614:87 , srv304002477:87 , srv626339278:87 , srv639130977:87 , srv770959284:87 , srv1567742960:88 , srv1609285031:88 , srv218838202:88 , srv667643400:88 , srv832461170:88 , srv898494655:88 , srv910882263:88 , srv1030454127:89 , srv1036949337:89 , srv1631928099:89 , srv2097606458:89 , srv340085249:89 , srv384144968:89 , srv695442170:89 , srv1041509480:90 , srv1838056171:90 , srv2130050830:90 , srv73682866:90 , srv1072479306:91 , srv13175002:91 , srv644134011:91 , srv1934050625:93 , srv1085450229:97 , srv411717100:99 , srv1451116855:467 }
2023-12-19 08:53:19,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 08:53:19,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv304002477=64, srv667643400=86, srv1232921944=14, srv1631928099=31, srv410009523=70, srv522609250=78, srv1130385530=13, srv544840652=80, srv437495540=72, srv626339278=81, srv1095237602=12, srv53892923=79, srv770959284=92, srv1706683212=33, srv1921482997=46, srv707913180=89, srv1237563329=15, srv149146822=26, srv13175002=17, srv1715910266=35, srv218838202=60, srv1605196217=29, srv2130050830=59, srv1064492877=6, srv639130977=83, srv910882263=98, srv1792075913=39, srv1437013581=21, srv411717100=71, srv898494655=96, srv2092577716=55, srv908830917=97, srv1740047702=38, srv1839504005=43, srv2074609934=53, srv146207618=25, srv1076217462=8, srv1707707133=34, srv233574079=61, srv50150982=77, srv145840923=24, srv301533848=63, srv1944407749=48, srv312136764=65, srv182688366=41, srv695442170=88, srv1934050625=47, srv384144968=68, srv1030454127=1, srv1716066545=36, srv690856059=87, srv1451116855=23, srv460453999=76, srv1906552381=45, srv707960131=90, srv73682866=91, srv453156320=74, srv1567742960=27, srv276664614=62, srv931012441=99, srv340085249=66, srv2021332841=52, srv2097606458=57, srv1082985407=9, srv1822005815=40, srv1330095782=18, srv627747083=82, srv644134011=84, srv832461170=94, srv812550658=93, srv1085450229=10, srv1954877855=49, srv1041509480=3, srv1575768022=28, srv1347373722=19, srv1728560918=37, srv409916443=69, srv1063014308=5, srv1838056171=42, srv2094397770=56, srv102743417=0, srv368837380=67, srv651007269=85, srv1994575146=51, srv19565653=50, srv2082463476=54, srv1347528864=20, srv458974766=75, srv1056183470=4, srv1072479306=7, srv1088923992=11, srv2115549121=58, srv1254205113=16, srv865231835=95, srv444825425=73, srv1846872242=44, srv144395226=22, srv1036949337=2, srv1609285031=30, srv1701298576=32} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 08:53:19,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 08:53:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 08:53:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 08:53:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 08:53:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 08:53:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 08:53:19,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 08:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 08:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 08:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 08:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 08:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 08:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 08:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 08:53:19,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 08:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 08:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 08:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 08:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 08:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 08:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 08:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 08:53:19,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 08:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 08:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 08:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 08:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 08:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 08:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 08:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 08:53:19,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 08:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 08:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 08:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 08:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 08:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 08:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 08:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 08:53:19,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 08:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 08:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 08:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 08:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 08:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 08:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 08:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 08:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 08:53:19,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 08:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 08:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 08:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 08:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 08:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 08:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 08:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 08:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 08:53:19,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 08:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 08:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 08:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 08:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 08:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 08:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 08:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 08:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 08:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 08:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 08:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 08:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 08:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 08:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 08:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 08:53:19,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 08:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 08:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 08:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 08:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 08:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 08:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 08:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 08:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 08:53:19,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 08:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 08:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 08:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 08:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 08:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 08:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 08:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 08:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 08:53:19,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 08:53:19,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 08:53:19,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 08:53:19,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 08:53:19,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 08:53:19,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 08:53:19,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 08:53:19,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 08:53:19,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 08:53:19,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 08:53:19,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 08:53:20,030 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042434929977611176, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053488830557307264, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042434929977611176, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17433333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:53:20,030 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 08:53:20,030 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17897747000864278, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.042434929977611176, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053488830557307264, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.042434929977611176, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17433333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 08:53:20,315 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 421 ms to try 5000 different iterations.  Found a solution that moves 2587 regions; Going from a computed imbalance of 0.17897747000864278 to a new imbalance of 0.01621860740158302. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024755192456539177); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04084956387388816, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28744444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024755192456539177); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:53:20,328 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv411717100:74 , srv1085450229:75 , srv1041509480:79 , srv13175002:80 , srv73682866:80 , srv1609285031:81 , srv1838056171:81 , srv2130050830:81 , srv1036949337:82 , srv1567742960:82 , srv2092577716:82 , srv340085249:82 , srv1030454127:83 , srv1064492877:83 , srv1072479306:83 , srv1076217462:83 , srv1232921944:83 , srv1934050625:83 , srv460453999:83 , srv644134011:83 , srv667643400:83 , srv832461170:83 , srv898494655:83 , srv910882263:83 , srv1130385530:84 , srv1237563329:84 , srv1575768022:84 , srv182688366:84 , srv19565653:84 , srv2097606458:84 , srv218838202:84 , srv276664614:84 , srv384144968:84 , srv626339278:84 , srv695442170:84 , srv102743417:85 , srv1330095782:85 , srv1631928099:85 , srv1715910266:85 , srv1839504005:85 , srv2021332841:85 , srv2082463476:85 , srv50150982:85 , srv627747083:85 , srv1056183470:86 , srv1082985407:86 , srv1254205113:86 , srv1347528864:86 , srv145840923:86 , srv1701298576:86 , srv1846872242:86 , srv2074609934:86 , srv2094397770:86 , srv304002477:86 , srv410009523:86 , srv453156320:86 , srv544840652:86 , srv639130977:86 , srv149146822:87 , srv1706683212:87 , srv1716066545:87 , srv1906552381:87 , srv1944407749:87 , srv1994575146:87 , srv2115549121:87 , srv301533848:87 , srv437495540:87 , srv690856059:87 , srv770959284:87 , srv865231835:87 , srv1347373722:88 , srv1437013581:88 , srv1707707133:88 , srv1728560918:88 , srv1740047702:88 , srv1822005815:88 , srv233574079:88 , srv409916443:88 , srv444825425:88 , srv522609250:88 , srv651007269:88 , srv707960131:88 , srv931012441:88 , srv1088923992:89 , srv1095237602:89 , srv144395226:89 , srv146207618:89 , srv1921482997:89 , srv312136764:89 , srv53892923:89 , srv707913180:89 , srv812550658:89 , srv1792075913:90 , srv908830917:90 , srv1605196217:91 , srv1954877855:91 , srv368837380:91 , srv458974766:91 , srv1063014308:92 , srv1451116855:527 }
2023-12-19 08:53:20,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 08:53:20,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv304002477=64, srv667643400=86, srv1232921944=14, srv1631928099=31, srv410009523=70, srv522609250=78, srv1130385530=13, srv544840652=80, srv437495540=72, srv626339278=81, srv1095237602=12, srv53892923=79, srv770959284=92, srv1706683212=33, srv1921482997=46, srv707913180=89, srv1237563329=15, srv149146822=26, srv13175002=17, srv1715910266=35, srv218838202=60, srv1605196217=29, srv2130050830=59, srv1064492877=6, srv639130977=83, srv910882263=98, srv1792075913=39, srv1437013581=21, srv411717100=71, srv898494655=96, srv2092577716=55, srv908830917=97, srv1740047702=38, srv1839504005=43, srv2074609934=53, srv146207618=25, srv1076217462=8, srv1707707133=34, srv233574079=61, srv50150982=77, srv145840923=24, srv301533848=63, srv1944407749=48, srv312136764=65, srv182688366=41, srv695442170=88, srv1934050625=47, srv384144968=68, srv1030454127=1, srv1716066545=36, srv690856059=87, srv1451116855=23, srv460453999=76, srv1906552381=45, srv707960131=90, srv73682866=91, srv453156320=74, srv1567742960=27, srv276664614=62, srv931012441=99, srv340085249=66, srv2021332841=52, srv2097606458=57, srv1082985407=9, srv1822005815=40, srv1330095782=18, srv627747083=82, srv644134011=84, srv832461170=94, srv812550658=93, srv1085450229=10, srv1954877855=49, srv1041509480=3, srv1575768022=28, srv1347373722=19, srv1728560918=37, srv409916443=69, srv1063014308=5, srv1838056171=42, srv2094397770=56, srv102743417=0, srv368837380=67, srv651007269=85, srv1994575146=51, srv19565653=50, srv2082463476=54, srv1347528864=20, srv458974766=75, srv1056183470=4, srv1072479306=7, srv1088923992=11, srv2115549121=58, srv1254205113=16, srv865231835=95, srv444825425=73, srv1846872242=44, srv144395226=22, srv1036949337=2, srv1609285031=30, srv1701298576=32} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 08:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 08:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 08:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 08:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 08:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 08:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 08:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 08:53:20,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 08:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 08:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 08:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 08:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 08:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 08:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 08:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 08:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 08:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 08:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 08:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 08:53:20,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 08:53:20,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 08:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 08:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 08:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 08:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 08:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 08:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 08:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 08:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 08:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 08:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 08:53:20,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 08:53:20,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 08:53:20,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 08:53:20,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 08:53:20,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 08:53:20,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 08:53:20,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 08:53:20,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 08:53:20,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 08:53:20,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 08:53:20,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 08:53:20,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 08:53:20,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 08:53:20,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 08:53:20,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 08:53:20,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 08:53:20,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 08:53:20,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 08:53:20,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 08:53:20,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 08:53:20,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 08:53:20,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 08:53:20,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 08:53:20,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 08:53:20,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 08:53:20,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 08:53:20,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 08:53:20,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 08:53:20,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 08:53:20,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 08:53:20,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 08:53:20,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 08:53:20,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 08:53:20,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 08:53:20,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 08:53:20,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 08:53:20,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 08:53:20,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 08:53:20,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 08:53:20,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 08:53:20,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 08:53:20,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 08:53:20,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 08:53:20,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 08:53:20,482 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024755192456539177); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04084956387388816, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024755192456539177); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:53:20,482 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 08:53:20,482 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016200492840412743, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024755192456539177); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04084956387388816, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024755192456539177); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 08:53:20,713 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 331 ms to try 5000 different iterations.  Found a solution that moves 1012 regions; Going from a computed imbalance of 0.016200492840412743 to a new imbalance of 9.045426406826402E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0077881924820476555); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01104017762019805); MoveCostFunction : (multiplier=7.0, imbalance=0.11244444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0077881924820476555); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:53:20,715 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1063014308:81 , srv1934050625:81 , srv1088923992:82 , srv1072479306:83 , srv1605196217:83 , srv1631928099:83 , srv1740047702:83 , srv1792075913:83 , srv1921482997:83 , srv458974766:83 , srv1056183470:84 , srv145840923:84 , srv1707707133:84 , srv1822005815:84 , srv1906552381:84 , srv1954877855:84 , srv2097606458:84 , srv368837380:84 , srv384144968:84 , srv409916443:84 , srv453156320:84 , srv53892923:84 , srv644134011:84 , srv770959284:84 , srv865231835:84 , srv908830917:84 , srv931012441:84 , srv1085450229:85 , srv1254205113:85 , srv13175002:85 , srv1347373722:85 , srv1701298576:85 , srv1715910266:85 , srv1839504005:85 , srv1944407749:85 , srv2115549121:85 , srv276664614:85 , srv304002477:85 , srv411717100:85 , srv437495540:85 , srv522609250:85 , srv544840652:85 , srv639130977:85 , srv651007269:85 , srv695442170:85 , srv707913180:85 , srv707960131:85 , srv1030454127:86 , srv1082985407:86 , srv1095237602:86 , srv1237563329:86 , srv1347528864:86 , srv1437013581:86 , srv144395226:86 , srv149146822:86 , srv1716066545:86 , srv182688366:86 , srv1994575146:86 , srv2094397770:86 , srv218838202:86 , srv301533848:86 , srv312136764:86 , srv340085249:86 , srv410009523:86 , srv444825425:86 , srv626339278:86 , srv667643400:86 , srv690856059:86 , srv812550658:86 , srv910882263:86 , srv1036949337:87 , srv1076217462:87 , srv1232921944:87 , srv1330095782:87 , srv146207618:87 , srv1567742960:87 , srv1575768022:87 , srv1706683212:87 , srv1728560918:87 , srv1838056171:87 , srv1846872242:87 , srv2021332841:87 , srv2074609934:87 , srv2082463476:87 , srv2092577716:87 , srv2130050830:87 , srv233574079:87 , srv50150982:87 , srv73682866:87 , srv832461170:87 , srv102743417:88 , srv1041509480:88 , srv1064492877:88 , srv1130385530:88 , srv627747083:88 , srv898494655:88 , srv1609285031:89 , srv19565653:89 , srv460453999:90 , srv1451116855:533 }
2023-12-19 08:53:20,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 08:53:20,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv304002477=64, srv667643400=86, srv1232921944=14, srv1631928099=31, srv410009523=70, srv522609250=78, srv1130385530=13, srv544840652=80, srv437495540=72, srv626339278=81, srv1095237602=12, srv53892923=79, srv770959284=92, srv1706683212=33, srv1921482997=46, srv707913180=89, srv1237563329=15, srv149146822=26, srv13175002=17, srv1715910266=35, srv218838202=60, srv1605196217=29, srv2130050830=59, srv1064492877=6, srv639130977=83, srv910882263=98, srv1792075913=39, srv1437013581=21, srv411717100=71, srv898494655=96, srv2092577716=55, srv908830917=97, srv1740047702=38, srv1839504005=43, srv2074609934=53, srv146207618=25, srv1076217462=8, srv1707707133=34, srv233574079=61, srv50150982=77, srv145840923=24, srv301533848=63, srv1944407749=48, srv312136764=65, srv182688366=41, srv695442170=88, srv1934050625=47, srv384144968=68, srv1030454127=1, srv1716066545=36, srv690856059=87, srv1451116855=23, srv460453999=76, srv1906552381=45, srv707960131=90, srv73682866=91, srv453156320=74, srv1567742960=27, srv276664614=62, srv931012441=99, srv340085249=66, srv2021332841=52, srv2097606458=57, srv1082985407=9, srv1822005815=40, srv1330095782=18, srv627747083=82, srv644134011=84, srv832461170=94, srv812550658=93, srv1085450229=10, srv1954877855=49, srv1041509480=3, srv1575768022=28, srv1347373722=19, srv1728560918=37, srv409916443=69, srv1063014308=5, srv1838056171=42, srv2094397770=56, srv102743417=0, srv368837380=67, srv651007269=85, srv1994575146=51, srv19565653=50, srv2082463476=54, srv1347528864=20, srv458974766=75, srv1056183470=4, srv1072479306=7, srv1088923992=11, srv2115549121=58, srv1254205113=16, srv865231835=95, srv444825425=73, srv1846872242=44, srv144395226=22, srv1036949337=2, srv1609285031=30, srv1701298576=32} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 08:53:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 08:53:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 08:53:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 08:53:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 08:53:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 08:53:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 08:53:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 08:53:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 08:53:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 08:53:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 08:53:20,730 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 08:53:20,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 08:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 08:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 08:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 08:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 08:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 08:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 08:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 08:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 08:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 08:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 08:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 08:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 08:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 08:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 08:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 08:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 08:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 08:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 08:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 08:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 08:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 08:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 08:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 08:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 08:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 08:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 08:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 08:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 08:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 08:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 08:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 08:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 08:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 08:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 08:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 08:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 08:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 08:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 08:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 08:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 08:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 08:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 08:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 08:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 08:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 08:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 08:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 08:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 08:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 08:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 08:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 08:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 08:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 08:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 08:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 08:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 08:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 08:53:20,849 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0077881924820476555); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01104017762019805); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0077881924820476555); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:53:20,849 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 08:53:20,850 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.974564652267754E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0077881924820476555); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01104017762019805); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0077881924820476555); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 08:53:21,181 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 429 ms to try 5000 different iterations.  Found a solution that moves 265 regions; Going from a computed imbalance of 8.974564652267754E-4 to a new imbalance of 2.7771497105670316E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.029444444444444443, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:53:21,182 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2082463476:83 , srv460453999:83 , srv627747083:83 , srv812550658:83 , srv898494655:83 , srv1030454127:84 , srv1036949337:84 , srv1072479306:84 , srv1082985407:84 , srv1088923992:84 , srv1095237602:84 , srv1330095782:84 , srv1347373722:84 , srv1437013581:84 , srv1609285031:84 , srv1631928099:84 , srv1707707133:84 , srv1728560918:84 , srv1838056171:84 , srv1906552381:84 , srv1954877855:84 , srv19565653:84 , srv2130050830:84 , srv218838202:84 , srv233574079:84 , srv301533848:84 , srv304002477:84 , srv312136764:84 , srv411717100:84 , srv437495540:84 , srv444825425:84 , srv522609250:84 , srv639130977:84 , srv644134011:84 , srv651007269:84 , srv707960131:84 , srv73682866:84 , srv770959284:84 , srv832461170:84 , srv931012441:84 , srv102743417:85 , srv1041509480:85 , srv1056183470:85 , srv1064492877:85 , srv1076217462:85 , srv1085450229:85 , srv1130385530:85 , srv1232921944:85 , srv1237563329:85 , srv1254205113:85 , srv144395226:85 , srv145840923:85 , srv146207618:85 , srv149146822:85 , srv1567742960:85 , srv1575768022:85 , srv1605196217:85 , srv1701298576:85 , srv1715910266:85 , srv1740047702:85 , srv182688366:85 , srv1839504005:85 , srv1846872242:85 , srv1921482997:85 , srv1934050625:85 , srv1944407749:85 , srv2021332841:85 , srv2074609934:85 , srv2094397770:85 , srv2097606458:85 , srv2115549121:85 , srv340085249:85 , srv368837380:85 , srv384144968:85 , srv410009523:85 , srv53892923:85 , srv544840652:85 , srv667643400:85 , srv690856059:85 , srv695442170:85 , srv707913180:85 , srv865231835:85 , srv908830917:85 , srv910882263:85 , srv1063014308:86 , srv13175002:86 , srv1347528864:86 , srv1706683212:86 , srv1716066545:86 , srv1792075913:86 , srv1822005815:86 , srv1994575146:86 , srv2092577716:86 , srv276664614:86 , srv409916443:86 , srv453156320:86 , srv458974766:86 , srv50150982:86 , srv626339278:86 , srv1451116855:615 }
2023-12-19 08:53:21,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 08:53:21,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv304002477=64, srv667643400=86, srv1232921944=14, srv1631928099=31, srv410009523=70, srv522609250=78, srv1130385530=13, srv544840652=80, srv437495540=72, srv626339278=81, srv1095237602=12, srv53892923=79, srv770959284=92, srv1706683212=33, srv1921482997=46, srv707913180=89, srv1237563329=15, srv149146822=26, srv13175002=17, srv1715910266=35, srv218838202=60, srv1605196217=29, srv2130050830=59, srv1064492877=6, srv639130977=83, srv910882263=98, srv1792075913=39, srv1437013581=21, srv411717100=71, srv898494655=96, srv2092577716=55, srv908830917=97, srv1740047702=38, srv1839504005=43, srv2074609934=53, srv146207618=25, srv1076217462=8, srv1707707133=34, srv233574079=61, srv50150982=77, srv145840923=24, srv301533848=63, srv1944407749=48, srv312136764=65, srv182688366=41, srv695442170=88, srv1934050625=47, srv384144968=68, srv1030454127=1, srv1716066545=36, srv690856059=87, srv1451116855=23, srv460453999=76, srv1906552381=45, srv707960131=90, srv73682866=91, srv453156320=74, srv1567742960=27, srv276664614=62, srv931012441=99, srv340085249=66, srv2021332841=52, srv2097606458=57, srv1082985407=9, srv1822005815=40, srv1330095782=18, srv627747083=82, srv644134011=84, srv832461170=94, srv812550658=93, srv1085450229=10, srv1954877855=49, srv1041509480=3, srv1575768022=28, srv1347373722=19, srv1728560918=37, srv409916443=69, srv1063014308=5, srv1838056171=42, srv2094397770=56, srv102743417=0, srv368837380=67, srv651007269=85, srv1994575146=51, srv19565653=50, srv2082463476=54, srv1347528864=20, srv458974766=75, srv1056183470=4, srv1072479306=7, srv1088923992=11, srv2115549121=58, srv1254205113=16, srv865231835=95, srv444825425=73, srv1846872242=44, srv144395226=22, srv1036949337=2, srv1609285031=30, srv1701298576=32} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 08:53:21,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 08:53:21,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 08:53:21,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 08:53:21,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 08:53:21,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 08:53:21,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 08:53:21,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 08:53:21,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 08:53:21,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 08:53:21,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 08:53:21,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 08:53:21,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 08:53:21,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 08:53:21,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 08:53:21,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 08:53:21,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 08:53:21,307 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:53:21,307 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-19 08:53:21,307 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.5915927445784734E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-19 08:53:21,531 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 321 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 2.5915927445784734E-5 to a new imbalance of 7.262297337147979E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:53:21,532 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1716066545:83 , srv1728560918:83 , srv1792075913:83 , srv1944407749:83 , srv626339278:83 , srv695442170:83 , srv102743417:84 , srv1030454127:84 , srv1036949337:84 , srv1041509480:84 , srv1056183470:84 , srv1063014308:84 , srv1064492877:84 , srv1076217462:84 , srv1082985407:84 , srv1085450229:84 , srv1095237602:84 , srv1130385530:84 , srv1232921944:84 , srv1237563329:84 , srv1254205113:84 , srv13175002:84 , srv1330095782:84 , srv1347373722:84 , srv1347528864:84 , srv1437013581:84 , srv144395226:84 , srv145840923:84 , srv146207618:84 , srv149146822:84 , srv1567742960:84 , srv1575768022:84 , srv1605196217:84 , srv1609285031:84 , srv1701298576:84 , srv1706683212:84 , srv1707707133:84 , srv1715910266:84 , srv1740047702:84 , srv1822005815:84 , srv182688366:84 , srv1838056171:84 , srv1839504005:84 , srv1846872242:84 , srv1906552381:84 , srv1921482997:84 , srv1934050625:84 , srv19565653:84 , srv1994575146:84 , srv2021332841:84 , srv2074609934:84 , srv2082463476:84 , srv2092577716:84 , srv2094397770:84 , srv2097606458:84 , srv2115549121:84 , srv2130050830:84 , srv218838202:84 , srv233574079:84 , srv276664614:84 , srv301533848:84 , srv304002477:84 , srv312136764:84 , srv340085249:84 , srv368837380:84 , srv384144968:84 , srv409916443:84 , srv410009523:84 , srv411717100:84 , srv437495540:84 , srv444825425:84 , srv453156320:84 , srv458974766:84 , srv460453999:84 , srv50150982:84 , srv522609250:84 , srv53892923:84 , srv544840652:84 , srv639130977:84 , srv644134011:84 , srv651007269:84 , srv667643400:84 , srv690856059:84 , srv707913180:84 , srv707960131:84 , srv770959284:84 , srv812550658:84 , srv832461170:84 , srv865231835:84 , srv898494655:84 , srv908830917:84 , srv910882263:84 , srv931012441:84 , srv1072479306:85 , srv1088923992:85 , srv1631928099:85 , srv1954877855:85 , srv627747083:85 , srv73682866:85 , srv1451116855:684 }
2023-12-19 08:53:21,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 08:53:21,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv304002477=64, srv667643400=86, srv1232921944=14, srv1631928099=31, srv410009523=70, srv522609250=78, srv1130385530=13, srv544840652=80, srv437495540=72, srv626339278=81, srv1095237602=12, srv53892923=79, srv770959284=92, srv1706683212=33, srv1921482997=46, srv707913180=89, srv1237563329=15, srv149146822=26, srv13175002=17, srv1715910266=35, srv218838202=60, srv1605196217=29, srv2130050830=59, srv1064492877=6, srv639130977=83, srv910882263=98, srv1792075913=39, srv1437013581=21, srv411717100=71, srv898494655=96, srv2092577716=55, srv908830917=97, srv1740047702=38, srv1839504005=43, srv2074609934=53, srv146207618=25, srv1076217462=8, srv1707707133=34, srv233574079=61, srv50150982=77, srv145840923=24, srv301533848=63, srv1944407749=48, srv312136764=65, srv182688366=41, srv695442170=88, srv1934050625=47, srv384144968=68, srv1030454127=1, srv1716066545=36, srv690856059=87, srv1451116855=23, srv460453999=76, srv1906552381=45, srv707960131=90, srv73682866=91, srv453156320=74, srv1567742960=27, srv276664614=62, srv931012441=99, srv340085249=66, srv2021332841=52, srv2097606458=57, srv1082985407=9, srv1822005815=40, srv1330095782=18, srv627747083=82, srv644134011=84, srv832461170=94, srv812550658=93, srv1085450229=10, srv1954877855=49, srv1041509480=3, srv1575768022=28, srv1347373722=19, srv1728560918=37, srv409916443=69, srv1063014308=5, srv1838056171=42, srv2094397770=56, srv102743417=0, srv368837380=67, srv651007269=85, srv1994575146=51, srv19565653=50, srv2082463476=54, srv1347528864=20, srv458974766=75, srv1056183470=4, srv1072479306=7, srv1088923992=11, srv2115549121=58, srv1254205113=16, srv865231835=95, srv444825425=73, srv1846872242=44, srv144395226=22, srv1036949337=2, srv1609285031=30, srv1701298576=32} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 08:53:21,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 08:53:21,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 08:53:21,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 08:53:21,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-19 08:53:21,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-19 08:53:21,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-19 08:53:21,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-19 08:53:21,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-19 08:53:21,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-19 08:53:21,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-19 08:53:21,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-19 08:53:21,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-19 08:53:21,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-19 08:53:21,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-19 08:53:21,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-19 08:53:21,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-19 08:53:21,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-19 08:53:21,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-19 08:53:21,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-19 08:53:21,656 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:53:21,657 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1716066545:83 , srv1728560918:83 , srv1792075913:83 , srv1944407749:83 , srv626339278:83 , srv695442170:83 , srv102743417:84 , srv1030454127:84 , srv1036949337:84 , srv1041509480:84 , srv1056183470:84 , srv1063014308:84 , srv1064492877:84 , srv1076217462:84 , srv1082985407:84 , srv1085450229:84 , srv1095237602:84 , srv1130385530:84 , srv1232921944:84 , srv1237563329:84 , srv1254205113:84 , srv13175002:84 , srv1330095782:84 , srv1347373722:84 , srv1347528864:84 , srv1437013581:84 , srv144395226:84 , srv145840923:84 , srv146207618:84 , srv149146822:84 , srv1567742960:84 , srv1575768022:84 , srv1605196217:84 , srv1609285031:84 , srv1701298576:84 , srv1706683212:84 , srv1707707133:84 , srv1715910266:84 , srv1740047702:84 , srv1822005815:84 , srv182688366:84 , srv1838056171:84 , srv1839504005:84 , srv1846872242:84 , srv1906552381:84 , srv1921482997:84 , srv1934050625:84 , srv19565653:84 , srv1994575146:84 , srv2021332841:84 , srv2074609934:84 , srv2082463476:84 , srv2092577716:84 , srv2094397770:84 , srv2097606458:84 , srv2115549121:84 , srv2130050830:84 , srv218838202:84 , srv233574079:84 , srv276664614:84 , srv301533848:84 , srv304002477:84 , srv312136764:84 , srv340085249:84 , srv368837380:84 , srv384144968:84 , srv409916443:84 , srv410009523:84 , srv411717100:84 , srv437495540:84 , srv444825425:84 , srv453156320:84 , srv458974766:84 , srv460453999:84 , srv50150982:84 , srv522609250:84 , srv53892923:84 , srv544840652:84 , srv639130977:84 , srv644134011:84 , srv651007269:84 , srv667643400:84 , srv690856059:84 , srv707913180:84 , srv707960131:84 , srv770959284:84 , srv812550658:84 , srv832461170:84 , srv865231835:84 , srv898494655:84 , srv908830917:84 , srv910882263:84 , srv931012441:84 , srv1072479306:85 , srv1088923992:85 , srv1631928099:85 , srv1954877855:85 , srv627747083:85 , srv73682866:85 , srv1451116855:684 }
2023-12-19 08:53:21,681 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 270) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=3184 (was 3779)
2023-12-19 08:53:21,688 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=171, AvailableMemoryMB=3183
2023-12-19 08:53:21,689 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-19 08:53:21,689 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-19 08:53:21,703 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv107963899:84 , srv1154014340:84 , srv1222056140:84 , srv1259115872:84 , srv1272283923:84 , srv1336785124:84 , srv1354868145:84 , srv1432664255:84 , srv1437465682:84 , srv1470452563:84 , srv1529926294:84 , srv1571297779:84 , srv1840277092:84 , srv1842119079:84 , srv1999925850:84 , srv2097119278:84 , srv287633723:84 , srv307610933:84 , srv35288526:84 , srv407650982:84 , srv407993506:84 , srv501058690:84 , srv521194185:84 , srv625340856:84 , srv663637985:84 , srv770475877:84 , srv842978868:84 , srv849052387:84 , srv997362785:84 , srv2027473650:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-19 08:53:21,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 08:53:21,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1259115872=3, srv1272283923=4, srv997362785=29, srv849052387=28, srv1470452563=9, srv1840277092=12, srv501058690=22, srv287633723=17, srv407650982=20, srv107963899=0, srv2027473650=15, srv663637985=25, srv1571297779=11, srv625340856=24, srv35288526=19, srv1529926294=10, srv770475877=26, srv1354868145=6, srv1999925850=14, srv1437465682=8, srv1154014340=1, srv842978868=27, srv521194185=23, srv1432664255=7, srv307610933=18, srv407993506=21, srv1222056140=2, srv1336785124=5, srv1842119079=13, srv2097119278=16} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 08:53:21,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 08:53:21,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 08:53:21,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 08:53:21,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 08:53:21,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 08:53:21,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 08:53:21,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 08:53:21,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 08:53:21,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 08:53:21,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 08:53:21,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 08:53:21,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 08:53:21,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 08:53:21,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 08:53:21,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 08:53:21,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 08:53:21,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 08:53:21,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 08:53:21,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 08:53:21,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 08:53:21,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 08:53:21,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 08:53:21,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 08:53:21,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 08:53:21,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 08:53:21,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 08:53:21,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 08:53:21,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 08:53:21,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 08:53:21,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 08:53:21,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-19 08:53:21,745 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0870434774754663, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:53:21,746 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912467314419575, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0870434774754663, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-19 08:55:21,725 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6023598 different iterations.  Found a solution that moves 1843 regions; Going from a computed imbalance of 0.9912467314419575 to a new imbalance of 4.3016539410932495E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6825925925925926, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:55:21,731 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv107963899:90 , srv1154014340:90 , srv1222056140:90 , srv1259115872:90 , srv1272283923:90 , srv1336785124:90 , srv1354868145:90 , srv1432664255:90 , srv1437465682:90 , srv1470452563:90 , srv1529926294:90 , srv1571297779:90 , srv1840277092:90 , srv1842119079:90 , srv1999925850:90 , srv2027473650:90 , srv2097119278:90 , srv287633723:90 , srv307610933:90 , srv35288526:90 , srv407650982:90 , srv407993506:90 , srv501058690:90 , srv521194185:90 , srv625340856:90 , srv663637985:90 , srv770475877:90 , srv842978868:90 , srv849052387:90 , srv997362785:90 }
2023-12-19 08:55:21,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-19 08:55:21,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1259115872=3, srv1272283923=4, srv997362785=29, srv849052387=28, srv1470452563=9, srv1840277092=12, srv501058690=22, srv287633723=17, srv407650982=20, srv107963899=0, srv2027473650=15, srv663637985=25, srv1571297779=11, srv625340856=24, srv35288526=19, srv1529926294=10, srv770475877=26, srv1354868145=6, srv1999925850=14, srv1437465682=8, srv1154014340=1, srv842978868=27, srv521194185=23, srv1432664255=7, srv307610933=18, srv407993506=21, srv1222056140=2, srv1336785124=5, srv1842119079=13, srv2097119278=16} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-19 08:55:21,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-19 08:55:21,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-19 08:55:21,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-19 08:55:21,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-19 08:55:21,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-19 08:55:21,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-19 08:55:21,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-19 08:55:21,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-19 08:55:21,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-19 08:55:21,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-19 08:55:21,748 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-19 08:55:21,748 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv107963899:90 , srv1154014340:90 , srv1222056140:90 , srv1259115872:90 , srv1272283923:90 , srv1336785124:90 , srv1354868145:90 , srv1432664255:90 , srv1437465682:90 , srv1470452563:90 , srv1529926294:90 , srv1571297779:90 , srv1840277092:90 , srv1842119079:90 , srv1999925850:90 , srv2027473650:90 , srv2097119278:90 , srv287633723:90 , srv307610933:90 , srv35288526:90 , srv407650982:90 , srv407993506:90 , srv501058690:90 , srv521194185:90 , srv625340856:90 , srv663637985:90 , srv770475877:90 , srv842978868:90 , srv849052387:90 , srv997362785:90 }
2023-12-19 08:55:21,763 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=188 (was 280), ProcessCount=171 (was 171), AvailableMemoryMB=2241 (was 3183)