2023-02-28 13:55:40,785 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-28 13:55:41,191 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-28 13:55:41,336 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-28 13:55:41,407 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-28 13:55:41,420 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-28 13:55:41,434 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=286, ProcessCount=164, AvailableMemoryMB=5484
2023-02-28 13:55:41,437 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-28 13:55:41,437 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-28 13:55:41,606 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1004544652:84 , srv1019499159:84 , srv1026817215:84 , srv1052196493:84 , srv1054903366:84 , srv1066678251:84 , srv1079864099:84 , srv1150485106:84 , srv1162718199:84 , srv1163763847:84 , srv1197714861:84 , srv1213825129:84 , srv1257220618:84 , srv1259822330:84 , srv1282885425:84 , srv1316292444:84 , srv1317900390:84 , srv1328337181:84 , srv1390291034:84 , srv1394398735:84 , srv1408603989:84 , srv1436360638:84 , srv1484875864:84 , srv1488018765:84 , srv1497923807:84 , srv1504944289:84 , srv1511267901:84 , srv1519417256:84 , srv1536827049:84 , srv1539658042:84 , srv154444050:84 , srv1548475063:84 , srv1556064985:84 , srv1601478459:84 , srv1615089000:84 , srv1616878505:84 , srv1625411737:84 , srv166245152:84 , srv1751105946:84 , srv1789281242:84 , srv179590984:84 , srv1813264760:84 , srv1834204196:84 , srv1850731773:84 , srv1857463557:84 , srv1860212734:84 , srv1861574636:84 , srv1873175972:84 , srv1879605374:84 , srv1912691623:84 , srv1923980981:84 , srv19703260:84 , srv1974430464:84 , srv1975879643:84 , srv2036664350:84 , srv2050531730:84 , srv2092203661:84 , srv2103185164:84 , srv2122982110:84 , srv231175281:84 , srv339767931:84 , srv355187434:84 , srv38023450:84 , srv392642651:84 , srv42177756:84 , srv421832969:84 , srv453612644:84 , srv460046373:84 , srv471011305:84 , srv554861524:84 , srv556544944:84 , srv559603534:84 , srv595304284:84 , srv605159594:84 , srv622401858:84 , srv639334406:84 , srv645898968:84 , srv652745841:84 , srv696497426:84 , srv771666592:84 , srv783607588:84 , srv803729788:84 , srv813698372:84 , srv820931025:84 , srv829537409:84 , srv846033244:84 , srv862875448:84 , srv865179656:84 , srv865533267:84 , srv866883697:84 , srv869575607:84 , srv894654718:84 , srv902483253:84 , srv917300342:84 , srv91765144:84 , srv937116477:84 , srv941317897:84 , srv960316898:84 , srv969536791:84 , srv896287403:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-28 13:55:41,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-28 13:55:41,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv179590984=40, srv1394398735=19, srv1813264760=41, srv1052196493=3, srv421832969=65, srv1511267901=26, srv969536791=99, srv339767931=60, srv639334406=75, srv1539658042=29, srv471011305=68, srv862875448=86, srv960316898=98, srv865179656=87, srv1504944289=25, srv595304284=72, srv1282885425=14, srv1912691623=49, srv1616878505=35, srv19703260=51, srv1556064985=32, srv1259822330=13, srv392642651=63, srv1601478459=33, srv554861524=69, srv1974430464=52, srv846033244=85, srv1317900390=16, srv355187434=61, srv1390291034=18, srv460046373=67, srv820931025=83, srv829537409=84, srv1615089000=34, srv1789281242=39, srv869575607=90, srv865533267=88, srv917300342=94, srv1861574636=46, srv1257220618=12, srv1625411737=36, srv1162718199=8, srv1488018765=23, srv1484875864=22, srv1026817215=2, srv1834204196=42, srv2036664350=54, srv1328337181=17, srv1163763847=9, srv1316292444=15, srv2103185164=57, srv771666592=79, srv1751105946=38, srv1436360638=21, srv1860212734=45, srv91765144=95, srv1879605374=48, srv803729788=81, srv941317897=97, srv894654718=91, srv1019499159=1, srv166245152=37, srv38023450=62, srv1497923807=24, srv902483253=93, srv937116477=96, srv1923980981=50, srv154444050=30, srv1873175972=47, srv1519417256=27, srv622401858=74, srv1004544652=0, srv1054903366=4, srv2122982110=58, srv783607588=80, srv645898968=76, srv1197714861=10, srv896287403=92, srv605159594=73, srv1857463557=44, srv1408603989=20, srv813698372=82, srv2092203661=56, srv559603534=71, srv1079864099=6, srv556544944=70, srv2050531730=55, srv866883697=89, srv1150485106=7, srv1850731773=43, srv1536827049=28, srv1548475063=31, srv453612644=66, srv652745841=77, srv1066678251=5, srv1975879643=53, srv231175281=59, srv42177756=64, srv696497426=78, srv1213825129=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-28 13:55:41,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-28 13:55:41,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-28 13:55:41,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-28 13:55:41,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-28 13:55:41,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-28 13:55:41,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-28 13:55:41,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-28 13:55:41,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-28 13:55:41,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-28 13:55:41,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-28 13:55:41,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-28 13:55:41,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-28 13:55:41,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-28 13:55:41,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-28 13:55:41,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-28 13:55:41,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-28 13:55:41,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-28 13:55:41,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-28 13:55:41,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-28 13:55:41,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-28 13:55:41,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-28 13:55:41,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-28 13:55:41,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-28 13:55:41,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-28 13:55:41,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-28 13:55:41,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-28 13:55:41,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-28 13:55:41,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-28 13:55:41,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-28 13:55:41,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-28 13:55:41,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-28 13:55:41,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-28 13:55:41,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-28 13:55:41,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-28 13:55:41,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-28 13:55:41,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-28 13:55:41,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-28 13:55:41,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-28 13:55:41,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-28 13:55:41,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-28 13:55:41,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-28 13:55:41,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-28 13:55:41,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-28 13:55:41,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-28 13:55:41,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-28 13:55:41,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-28 13:55:41,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-28 13:55:41,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-28 13:55:41,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-28 13:55:41,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-28 13:55:41,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-28 13:55:41,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-28 13:55:41,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-28 13:55:41,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-28 13:55:41,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-28 13:55:41,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-28 13:55:41,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-28 13:55:41,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-28 13:55:41,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-28 13:55:41,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-28 13:55:41,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-28 13:55:41,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-28 13:55:41,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-28 13:55:41,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-28 13:55:41,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-28 13:55:41,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-28 13:55:41,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-28 13:55:41,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-28 13:55:41,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-28 13:55:41,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-28 13:55:41,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-28 13:55:41,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-28 13:55:41,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-28 13:55:41,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-28 13:55:41,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-28 13:55:41,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-28 13:55:41,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-28 13:55:41,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-28 13:55:41,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-28 13:55:41,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-28 13:55:41,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-28 13:55:41,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-28 13:55:41,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-28 13:55:41,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-28 13:55:41,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-28 13:55:41,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-28 13:55:41,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-28 13:55:41,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-28 13:55:41,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-28 13:55:41,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-28 13:55:41,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-28 13:55:41,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-28 13:55:41,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-28 13:55:41,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-28 13:55:41,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-28 13:55:41,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-28 13:55:41,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-28 13:55:41,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-28 13:55:41,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-28 13:55:41,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-28 13:55:41,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-28 13:55:42,067 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:55:42,068 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-28 13:55:42,068 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-28 13:55:42,348 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 534 ms to try 5000 different iterations.  Found a solution that moves 4640 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18248498937150595. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041094576102698524, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05691468796319956, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5155555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041094576102698524, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17816666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23991666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:55:42,363 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1789281242:79 , srv38023450:81 , srv1163763847:82 , srv1601478459:82 , srv1615089000:82 , srv1813264760:82 , srv696497426:82 , srv869575607:82 , srv902483253:82 , srv1488018765:83 , srv1497923807:83 , srv1616878505:83 , srv453612644:83 , srv862875448:83 , srv1197714861:84 , srv1328337181:84 , srv1394398735:84 , srv1548475063:84 , srv1751105946:84 , srv1879605374:84 , srv1912691623:84 , srv554861524:84 , srv595304284:84 , srv865533267:84 , srv1052196493:85 , srv1150485106:85 , srv1162718199:85 , srv1257220618:85 , srv1259822330:85 , srv1511267901:85 , srv1519417256:85 , srv1860212734:85 , srv1861574636:85 , srv1974430464:85 , srv231175281:85 , srv639334406:85 , srv894654718:85 , srv937116477:85 , srv960316898:85 , srv1019499159:86 , srv1066678251:86 , srv1079864099:86 , srv1213825129:86 , srv1316292444:86 , srv1408603989:86 , srv166245152:86 , srv1850731773:86 , srv1873175972:86 , srv1923980981:86 , srv2122982110:86 , srv460046373:86 , srv471011305:86 , srv556544944:86 , srv559603534:86 , srv652745841:86 , srv803729788:86 , srv813698372:86 , srv1054903366:87 , srv1282885425:87 , srv1317900390:87 , srv1436360638:87 , srv154444050:87 , srv19703260:87 , srv2092203661:87 , srv2103185164:87 , srv421832969:87 , srv622401858:87 , srv771666592:87 , srv820931025:87 , srv829537409:87 , srv846033244:87 , srv969536791:87 , srv1390291034:88 , srv1504944289:88 , srv1536827049:88 , srv179590984:88 , srv1975879643:88 , srv2050531730:88 , srv42177756:88 , srv917300342:88 , srv1026817215:89 , srv1539658042:89 , srv1556064985:89 , srv1625411737:89 , srv355187434:89 , srv392642651:89 , srv605159594:89 , srv865179656:89 , srv91765144:89 , srv941317897:89 , srv2036664350:90 , srv645898968:90 , srv1484875864:91 , srv866883697:91 , srv1834204196:93 , srv1857463557:94 , srv1004544652:95 , srv339767931:95 , srv783607588:95 , srv896287403:455 }
2023-02-28 13:55:42,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-28 13:55:42,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv179590984=40, srv1394398735=19, srv1813264760=41, srv1052196493=3, srv421832969=65, srv1511267901=26, srv969536791=99, srv339767931=60, srv639334406=75, srv1539658042=29, srv471011305=68, srv862875448=86, srv960316898=98, srv865179656=87, srv1504944289=25, srv595304284=72, srv1282885425=14, srv1912691623=49, srv1616878505=35, srv19703260=51, srv1556064985=32, srv1259822330=13, srv392642651=63, srv1601478459=33, srv554861524=69, srv1974430464=52, srv846033244=85, srv1317900390=16, srv355187434=61, srv1390291034=18, srv460046373=67, srv820931025=83, srv829537409=84, srv1615089000=34, srv1789281242=39, srv869575607=90, srv865533267=88, srv917300342=94, srv1861574636=46, srv1257220618=12, srv1625411737=36, srv1162718199=8, srv1488018765=23, srv1484875864=22, srv1026817215=2, srv1834204196=42, srv2036664350=54, srv1328337181=17, srv1163763847=9, srv1316292444=15, srv2103185164=57, srv771666592=79, srv1751105946=38, srv1436360638=21, srv1860212734=45, srv91765144=95, srv1879605374=48, srv803729788=81, srv941317897=97, srv894654718=91, srv1019499159=1, srv166245152=37, srv38023450=62, srv1497923807=24, srv902483253=93, srv937116477=96, srv1923980981=50, srv154444050=30, srv1873175972=47, srv1519417256=27, srv622401858=74, srv1004544652=0, srv1054903366=4, srv2122982110=58, srv783607588=80, srv645898968=76, srv1197714861=10, srv896287403=92, srv605159594=73, srv1857463557=44, srv1408603989=20, srv813698372=82, srv2092203661=56, srv559603534=71, srv1079864099=6, srv556544944=70, srv2050531730=55, srv866883697=89, srv1150485106=7, srv1850731773=43, srv1536827049=28, srv1548475063=31, srv453612644=66, srv652745841=77, srv1066678251=5, srv1975879643=53, srv231175281=59, srv42177756=64, srv696497426=78, srv1213825129=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-28 13:55:42,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-28 13:55:42,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-28 13:55:42,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-28 13:55:42,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-28 13:55:42,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-28 13:55:42,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-28 13:55:42,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-28 13:55:42,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-28 13:55:42,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-28 13:55:42,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-28 13:55:42,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-28 13:55:42,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-28 13:55:42,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-28 13:55:42,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-28 13:55:42,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-28 13:55:42,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-28 13:55:42,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-28 13:55:42,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-28 13:55:42,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-28 13:55:42,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-28 13:55:42,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-28 13:55:42,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-28 13:55:42,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-28 13:55:42,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-28 13:55:42,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-28 13:55:42,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-28 13:55:42,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-28 13:55:42,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-28 13:55:42,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-28 13:55:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-28 13:55:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-28 13:55:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-28 13:55:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-28 13:55:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-28 13:55:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-28 13:55:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-28 13:55:42,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-28 13:55:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-28 13:55:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-28 13:55:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-28 13:55:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-28 13:55:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-28 13:55:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-28 13:55:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-28 13:55:42,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-28 13:55:42,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-28 13:55:42,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-28 13:55:42,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-28 13:55:42,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-28 13:55:42,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-28 13:55:42,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-28 13:55:42,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-28 13:55:42,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-28 13:55:42,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-28 13:55:42,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-28 13:55:42,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-28 13:55:42,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-28 13:55:42,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-28 13:55:42,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-28 13:55:42,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-28 13:55:42,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-28 13:55:42,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-28 13:55:42,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-28 13:55:42,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-28 13:55:42,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-28 13:55:42,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-28 13:55:42,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-28 13:55:42,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-28 13:55:42,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-28 13:55:42,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-28 13:55:42,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-28 13:55:42,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-28 13:55:42,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-28 13:55:42,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-28 13:55:42,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-28 13:55:42,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-28 13:55:42,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-28 13:55:42,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-28 13:55:42,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-28 13:55:42,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-28 13:55:42,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-28 13:55:42,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-28 13:55:42,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-28 13:55:42,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-28 13:55:42,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-28 13:55:42,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-28 13:55:42,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-28 13:55:42,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-28 13:55:42,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-28 13:55:42,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-28 13:55:42,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-28 13:55:42,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-28 13:55:42,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-28 13:55:42,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-28 13:55:42,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-28 13:55:42,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-28 13:55:42,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-28 13:55:42,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-28 13:55:42,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-28 13:55:42,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-28 13:55:42,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-28 13:55:42,550 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041094576102698524, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05691468796319956, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041094576102698524, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17816666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23991666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:55:42,550 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-28 13:55:42,551 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18245249939708383, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041094576102698524, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05691468796319956, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041094576102698524, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17816666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23991666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-28 13:55:42,804 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 375 ms to try 5000 different iterations.  Found a solution that moves 2607 regions; Going from a computed imbalance of 0.18245249939708383 to a new imbalance of 0.015888295610378404. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023390715610156227); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03556502399180406, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2896666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023390715610156227); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04325, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:55:42,813 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1004544652:75 , srv339767931:76 , srv783607588:76 , srv1857463557:78 , srv1834204196:80 , srv866883697:80 , srv1026817215:81 , srv1556064985:81 , srv865179656:81 , srv1484875864:82 , srv1539658042:82 , srv1625411737:82 , srv645898968:82 , srv1054903366:83 , srv1282885425:83 , srv1390291034:83 , srv1504944289:83 , srv2036664350:83 , srv355187434:83 , srv392642651:83 , srv605159594:83 , srv846033244:83 , srv1408603989:84 , srv179590984:84 , srv19703260:84 , srv42177756:84 , srv622401858:84 , srv771666592:84 , srv1052196493:85 , srv1079864099:85 , srv1316292444:85 , srv1850731773:85 , srv1923980981:85 , srv1975879643:85 , srv2050531730:85 , srv2103185164:85 , srv652745841:85 , srv803729788:85 , srv820931025:85 , srv829537409:85 , srv91765144:85 , srv969536791:85 , srv1066678251:86 , srv1162718199:86 , srv1213825129:86 , srv1317900390:86 , srv1436360638:86 , srv1519417256:86 , srv166245152:86 , srv1873175972:86 , srv1879605374:86 , srv1974430464:86 , srv460046373:86 , srv556544944:86 , srv639334406:86 , srv813698372:86 , srv941317897:86 , srv1019499159:87 , srv1197714861:87 , srv1257220618:87 , srv1497923807:87 , srv1511267901:87 , srv1536827049:87 , srv154444050:87 , srv231175281:87 , srv421832969:87 , srv559603534:87 , srv595304284:87 , srv862875448:87 , srv865533267:87 , srv894654718:87 , srv917300342:87 , srv960316898:87 , srv1259822330:88 , srv1394398735:88 , srv1488018765:88 , srv1616878505:88 , srv1751105946:88 , srv1860212734:88 , srv1861574636:88 , srv1912691623:88 , srv2092203661:88 , srv2122982110:88 , srv453612644:88 , srv554861524:88 , srv902483253:88 , srv937116477:88 , srv1548475063:89 , srv1813264760:89 , srv471011305:89 , srv696497426:89 , srv1150485106:90 , srv1163763847:90 , srv1328337181:90 , srv1615089000:90 , srv38023450:90 , srv869575607:91 , srv1601478459:92 , srv1789281242:93 , srv896287403:527 }
2023-02-28 13:55:42,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-28 13:55:42,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv179590984=40, srv1394398735=19, srv1813264760=41, srv1052196493=3, srv421832969=65, srv1511267901=26, srv969536791=99, srv339767931=60, srv639334406=75, srv1539658042=29, srv471011305=68, srv862875448=86, srv960316898=98, srv865179656=87, srv1504944289=25, srv595304284=72, srv1282885425=14, srv1912691623=49, srv1616878505=35, srv19703260=51, srv1556064985=32, srv1259822330=13, srv392642651=63, srv1601478459=33, srv554861524=69, srv1974430464=52, srv846033244=85, srv1317900390=16, srv355187434=61, srv1390291034=18, srv460046373=67, srv820931025=83, srv829537409=84, srv1615089000=34, srv1789281242=39, srv869575607=90, srv865533267=88, srv917300342=94, srv1861574636=46, srv1257220618=12, srv1625411737=36, srv1162718199=8, srv1488018765=23, srv1484875864=22, srv1026817215=2, srv1834204196=42, srv2036664350=54, srv1328337181=17, srv1163763847=9, srv1316292444=15, srv2103185164=57, srv771666592=79, srv1751105946=38, srv1436360638=21, srv1860212734=45, srv91765144=95, srv1879605374=48, srv803729788=81, srv941317897=97, srv894654718=91, srv1019499159=1, srv166245152=37, srv38023450=62, srv1497923807=24, srv902483253=93, srv937116477=96, srv1923980981=50, srv154444050=30, srv1873175972=47, srv1519417256=27, srv622401858=74, srv1004544652=0, srv1054903366=4, srv2122982110=58, srv783607588=80, srv645898968=76, srv1197714861=10, srv896287403=92, srv605159594=73, srv1857463557=44, srv1408603989=20, srv813698372=82, srv2092203661=56, srv559603534=71, srv1079864099=6, srv556544944=70, srv2050531730=55, srv866883697=89, srv1150485106=7, srv1850731773=43, srv1536827049=28, srv1548475063=31, srv453612644=66, srv652745841=77, srv1066678251=5, srv1975879643=53, srv231175281=59, srv42177756=64, srv696497426=78, srv1213825129=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-28 13:55:42,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-28 13:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-28 13:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-28 13:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-28 13:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-28 13:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-28 13:55:42,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-28 13:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-28 13:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-28 13:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-28 13:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-28 13:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-28 13:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-28 13:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-28 13:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-28 13:55:42,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-28 13:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-28 13:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-28 13:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-28 13:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-28 13:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-28 13:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-28 13:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-28 13:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-28 13:55:42,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-28 13:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-28 13:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-28 13:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-28 13:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-28 13:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-28 13:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-28 13:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-28 13:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-28 13:55:42,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-28 13:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-28 13:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-28 13:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-28 13:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-28 13:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-28 13:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-28 13:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-28 13:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-28 13:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-28 13:55:42,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-28 13:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-28 13:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-28 13:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-28 13:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-28 13:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-28 13:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-28 13:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-28 13:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-28 13:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-28 13:55:42,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-28 13:55:42,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-28 13:55:42,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-28 13:55:42,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-28 13:55:42,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-28 13:55:42,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-28 13:55:42,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-28 13:55:42,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-28 13:55:42,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-28 13:55:42,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-28 13:55:42,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-28 13:55:42,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-28 13:55:42,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-28 13:55:42,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-28 13:55:42,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-28 13:55:42,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-28 13:55:42,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-28 13:55:42,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-28 13:55:42,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-28 13:55:42,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-28 13:55:42,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-28 13:55:42,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-28 13:55:42,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-28 13:55:42,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-28 13:55:42,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-28 13:55:42,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-28 13:55:42,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-28 13:55:42,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-28 13:55:42,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-28 13:55:42,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-28 13:55:42,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-28 13:55:42,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-28 13:55:42,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-28 13:55:42,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-28 13:55:42,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-28 13:55:42,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-28 13:55:42,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-28 13:55:42,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-28 13:55:42,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-28 13:55:42,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-28 13:55:42,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-28 13:55:42,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-28 13:55:42,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-28 13:55:42,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-28 13:55:42,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-28 13:55:42,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-28 13:55:42,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-28 13:55:42,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-28 13:55:42,960 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023390715610156227); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03556502399180406, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023390715610156227); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04325, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:55:42,960 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-28 13:55:42,961 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01587004100621493, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023390715610156227); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03556502399180406, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023390715610156227); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04325, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-28 13:55:43,237 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 371 ms to try 5000 different iterations.  Found a solution that moves 989 regions; Going from a computed imbalance of 0.01587004100621493 to a new imbalance of 6.176929656966986E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007449376057184372); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009380352942419313); MoveCostFunction : (multiplier=7.0, imbalance=0.10988888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007449376057184372); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:55:43,245 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv154444050:82 , srv917300342:82 , srv1150485106:83 , srv1328337181:83 , srv1601478459:83 , srv2036664350:83 , srv2092203661:83 , srv2122982110:83 , srv421832969:83 , srv471011305:83 , srv937116477:83 , srv941317897:83 , srv1019499159:84 , srv1259822330:84 , srv1317900390:84 , srv1536827049:84 , srv1548475063:84 , srv1834204196:84 , srv1860212734:84 , srv42177756:84 , srv460046373:84 , srv554861524:84 , srv559603534:84 , srv1066678251:85 , srv1163763847:85 , srv1257220618:85 , srv1394398735:85 , srv1436360638:85 , srv1484875864:85 , srv1615089000:85 , srv166245152:85 , srv179590984:85 , srv1857463557:85 , srv2103185164:85 , srv231175281:85 , srv355187434:85 , srv392642651:85 , srv803729788:85 , srv813698372:85 , srv829537409:85 , srv866883697:85 , srv869575607:85 , srv91765144:85 , srv960316898:85 , srv969536791:85 , srv1079864099:86 , srv1162718199:86 , srv1197714861:86 , srv1213825129:86 , srv1390291034:86 , srv1488018765:86 , srv1504944289:86 , srv1511267901:86 , srv1519417256:86 , srv1539658042:86 , srv1616878505:86 , srv1625411737:86 , srv1751105946:86 , srv1789281242:86 , srv1813264760:86 , srv1861574636:86 , srv1873175972:86 , srv1912691623:86 , srv1975879643:86 , srv2050531730:86 , srv339767931:86 , srv38023450:86 , srv453612644:86 , srv556544944:86 , srv595304284:86 , srv605159594:86 , srv622401858:86 , srv639334406:86 , srv645898968:86 , srv696497426:86 , srv783607588:86 , srv820931025:86 , srv894654718:86 , srv1004544652:87 , srv1052196493:87 , srv1054903366:87 , srv1282885425:87 , srv1316292444:87 , srv1497923807:87 , srv1556064985:87 , srv1850731773:87 , srv1879605374:87 , srv1923980981:87 , srv1974430464:87 , srv652745841:87 , srv771666592:87 , srv846033244:87 , srv865533267:87 , srv902483253:87 , srv1026817215:88 , srv1408603989:88 , srv19703260:88 , srv862875448:88 , srv865179656:88 , srv896287403:542 }
2023-02-28 13:55:43,252 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-28 13:55:43,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv179590984=40, srv1394398735=19, srv1813264760=41, srv1052196493=3, srv421832969=65, srv1511267901=26, srv969536791=99, srv339767931=60, srv639334406=75, srv1539658042=29, srv471011305=68, srv862875448=86, srv960316898=98, srv865179656=87, srv1504944289=25, srv595304284=72, srv1282885425=14, srv1912691623=49, srv1616878505=35, srv19703260=51, srv1556064985=32, srv1259822330=13, srv392642651=63, srv1601478459=33, srv554861524=69, srv1974430464=52, srv846033244=85, srv1317900390=16, srv355187434=61, srv1390291034=18, srv460046373=67, srv820931025=83, srv829537409=84, srv1615089000=34, srv1789281242=39, srv869575607=90, srv865533267=88, srv917300342=94, srv1861574636=46, srv1257220618=12, srv1625411737=36, srv1162718199=8, srv1488018765=23, srv1484875864=22, srv1026817215=2, srv1834204196=42, srv2036664350=54, srv1328337181=17, srv1163763847=9, srv1316292444=15, srv2103185164=57, srv771666592=79, srv1751105946=38, srv1436360638=21, srv1860212734=45, srv91765144=95, srv1879605374=48, srv803729788=81, srv941317897=97, srv894654718=91, srv1019499159=1, srv166245152=37, srv38023450=62, srv1497923807=24, srv902483253=93, srv937116477=96, srv1923980981=50, srv154444050=30, srv1873175972=47, srv1519417256=27, srv622401858=74, srv1004544652=0, srv1054903366=4, srv2122982110=58, srv783607588=80, srv645898968=76, srv1197714861=10, srv896287403=92, srv605159594=73, srv1857463557=44, srv1408603989=20, srv813698372=82, srv2092203661=56, srv559603534=71, srv1079864099=6, srv556544944=70, srv2050531730=55, srv866883697=89, srv1150485106=7, srv1850731773=43, srv1536827049=28, srv1548475063=31, srv453612644=66, srv652745841=77, srv1066678251=5, srv1975879643=53, srv231175281=59, srv42177756=64, srv696497426=78, srv1213825129=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-28 13:55:43,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-28 13:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-28 13:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-28 13:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-28 13:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-28 13:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-28 13:55:43,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-28 13:55:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-28 13:55:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-28 13:55:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-28 13:55:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-28 13:55:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-28 13:55:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-28 13:55:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-28 13:55:43,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-28 13:55:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-28 13:55:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-28 13:55:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-28 13:55:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-28 13:55:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-28 13:55:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-28 13:55:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-28 13:55:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-28 13:55:43,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-28 13:55:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-28 13:55:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-28 13:55:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-28 13:55:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-28 13:55:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-28 13:55:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-28 13:55:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-28 13:55:43,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-28 13:55:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-28 13:55:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-28 13:55:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-28 13:55:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-28 13:55:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-28 13:55:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-28 13:55:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-28 13:55:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-28 13:55:43,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-28 13:55:43,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-28 13:55:43,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-28 13:55:43,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-28 13:55:43,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-28 13:55:43,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-28 13:55:43,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-28 13:55:43,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-28 13:55:43,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-28 13:55:43,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-28 13:55:43,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-28 13:55:43,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-28 13:55:43,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-28 13:55:43,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-28 13:55:43,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-28 13:55:43,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-28 13:55:43,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-28 13:55:43,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-28 13:55:43,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-28 13:55:43,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-28 13:55:43,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-28 13:55:43,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-28 13:55:43,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-28 13:55:43,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-28 13:55:43,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-28 13:55:43,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-28 13:55:43,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-28 13:55:43,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-28 13:55:43,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-28 13:55:43,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-28 13:55:43,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-28 13:55:43,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-28 13:55:43,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-28 13:55:43,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-28 13:55:43,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-28 13:55:43,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-28 13:55:43,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-28 13:55:43,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-28 13:55:43,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-28 13:55:43,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-28 13:55:43,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-28 13:55:43,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-28 13:55:43,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-28 13:55:43,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-28 13:55:43,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-28 13:55:43,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-28 13:55:43,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-28 13:55:43,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-28 13:55:43,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-28 13:55:43,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-28 13:55:43,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-28 13:55:43,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-28 13:55:43,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-28 13:55:43,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-28 13:55:43,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-28 13:55:43,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-28 13:55:43,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-28 13:55:43,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-28 13:55:43,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-28 13:55:43,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-28 13:55:43,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-28 13:55:43,426 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007449376057184372); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009380352942419313); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007449376057184372); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:55:43,427 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-28 13:55:43,428 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.107678396830124E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007449376057184372); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009380352942419313); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007449376057184372); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-28 13:55:43,712 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 403 ms to try 5000 different iterations.  Found a solution that moves 284 regions; Going from a computed imbalance of 6.107678396830124E-4 to a new imbalance of 3.488937060972757E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.03155555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:55:43,714 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1436360638:83 , srv1536827049:83 , srv1861574636:83 , srv19703260:83 , srv1975879643:83 , srv2050531730:83 , srv91765144:83 , srv1026817215:84 , srv1163763847:84 , srv1213825129:84 , srv1408603989:84 , srv1484875864:84 , srv1511267901:84 , srv1556064985:84 , srv166245152:84 , srv1751105946:84 , srv1789281242:84 , srv1850731773:84 , srv1879605374:84 , srv1912691623:84 , srv1923980981:84 , srv2092203661:84 , srv471011305:84 , srv556544944:84 , srv605159594:84 , srv645898968:84 , srv652745841:84 , srv771666592:84 , srv783607588:84 , srv820931025:84 , srv862875448:84 , srv865179656:84 , srv865533267:84 , srv869575607:84 , srv894654718:84 , srv941317897:84 , srv1004544652:85 , srv1019499159:85 , srv1052196493:85 , srv1054903366:85 , srv1066678251:85 , srv1079864099:85 , srv1150485106:85 , srv1162718199:85 , srv1197714861:85 , srv1257220618:85 , srv1259822330:85 , srv1282885425:85 , srv1316292444:85 , srv1317900390:85 , srv1328337181:85 , srv1390291034:85 , srv1394398735:85 , srv1488018765:85 , srv1497923807:85 , srv1504944289:85 , srv1519417256:85 , srv1539658042:85 , srv1548475063:85 , srv1601478459:85 , srv1615089000:85 , srv1616878505:85 , srv1625411737:85 , srv179590984:85 , srv1813264760:85 , srv1834204196:85 , srv1857463557:85 , srv1860212734:85 , srv1873175972:85 , srv1974430464:85 , srv2103185164:85 , srv2122982110:85 , srv231175281:85 , srv339767931:85 , srv355187434:85 , srv38023450:85 , srv392642651:85 , srv421832969:85 , srv453612644:85 , srv559603534:85 , srv595304284:85 , srv622401858:85 , srv639334406:85 , srv696497426:85 , srv813698372:85 , srv846033244:85 , srv902483253:85 , srv917300342:85 , srv969536791:85 , srv154444050:86 , srv2036664350:86 , srv42177756:86 , srv460046373:86 , srv554861524:86 , srv803729788:86 , srv829537409:86 , srv866883697:86 , srv937116477:86 , srv960316898:86 , srv896287403:618 }
2023-02-28 13:55:43,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-28 13:55:43,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv179590984=40, srv1394398735=19, srv1813264760=41, srv1052196493=3, srv421832969=65, srv1511267901=26, srv969536791=99, srv339767931=60, srv639334406=75, srv1539658042=29, srv471011305=68, srv862875448=86, srv960316898=98, srv865179656=87, srv1504944289=25, srv595304284=72, srv1282885425=14, srv1912691623=49, srv1616878505=35, srv19703260=51, srv1556064985=32, srv1259822330=13, srv392642651=63, srv1601478459=33, srv554861524=69, srv1974430464=52, srv846033244=85, srv1317900390=16, srv355187434=61, srv1390291034=18, srv460046373=67, srv820931025=83, srv829537409=84, srv1615089000=34, srv1789281242=39, srv869575607=90, srv865533267=88, srv917300342=94, srv1861574636=46, srv1257220618=12, srv1625411737=36, srv1162718199=8, srv1488018765=23, srv1484875864=22, srv1026817215=2, srv1834204196=42, srv2036664350=54, srv1328337181=17, srv1163763847=9, srv1316292444=15, srv2103185164=57, srv771666592=79, srv1751105946=38, srv1436360638=21, srv1860212734=45, srv91765144=95, srv1879605374=48, srv803729788=81, srv941317897=97, srv894654718=91, srv1019499159=1, srv166245152=37, srv38023450=62, srv1497923807=24, srv902483253=93, srv937116477=96, srv1923980981=50, srv154444050=30, srv1873175972=47, srv1519417256=27, srv622401858=74, srv1004544652=0, srv1054903366=4, srv2122982110=58, srv783607588=80, srv645898968=76, srv1197714861=10, srv896287403=92, srv605159594=73, srv1857463557=44, srv1408603989=20, srv813698372=82, srv2092203661=56, srv559603534=71, srv1079864099=6, srv556544944=70, srv2050531730=55, srv866883697=89, srv1150485106=7, srv1850731773=43, srv1536827049=28, srv1548475063=31, srv453612644=66, srv652745841=77, srv1066678251=5, srv1975879643=53, srv231175281=59, srv42177756=64, srv696497426=78, srv1213825129=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-28 13:55:43,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-28 13:55:43,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-28 13:55:43,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-28 13:55:43,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-28 13:55:43,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-28 13:55:43,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-28 13:55:43,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-28 13:55:43,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-28 13:55:43,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-28 13:55:43,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-28 13:55:43,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-28 13:55:43,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-28 13:55:43,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-28 13:55:43,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-28 13:55:43,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-28 13:55:43,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-28 13:55:43,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-28 13:55:43,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-28 13:55:43,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-28 13:55:43,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-28 13:55:43,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-28 13:55:43,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-28 13:55:43,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-28 13:55:43,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-28 13:55:43,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-28 13:55:43,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-28 13:55:43,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-28 13:55:43,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-28 13:55:43,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-28 13:55:43,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-28 13:55:43,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-28 13:55:43,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-28 13:55:43,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-28 13:55:43,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-28 13:55:43,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-28 13:55:43,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-28 13:55:43,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-28 13:55:43,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-28 13:55:43,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-28 13:55:43,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-28 13:55:43,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-28 13:55:43,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-28 13:55:43,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-28 13:55:43,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-28 13:55:43,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-28 13:55:43,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-28 13:55:43,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-28 13:55:43,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-28 13:55:43,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-28 13:55:43,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-28 13:55:43,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-28 13:55:43,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-28 13:55:43,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-28 13:55:43,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-28 13:55:43,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-28 13:55:43,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-28 13:55:43,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-28 13:55:43,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-28 13:55:43,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-28 13:55:43,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-28 13:55:43,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-28 13:55:43,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-28 13:55:43,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-28 13:55:43,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-28 13:55:43,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-28 13:55:43,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-28 13:55:43,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-28 13:55:43,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-28 13:55:43,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-28 13:55:43,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-28 13:55:43,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-28 13:55:43,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-28 13:55:43,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-28 13:55:43,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-28 13:55:43,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-28 13:55:43,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-28 13:55:43,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-28 13:55:43,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-28 13:55:43,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-28 13:55:43,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-28 13:55:43,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-28 13:55:43,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-28 13:55:43,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-28 13:55:43,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-28 13:55:43,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-28 13:55:43,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-28 13:55:43,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-28 13:55:43,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-28 13:55:43,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-28 13:55:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-28 13:55:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-28 13:55:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-28 13:55:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-28 13:55:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-28 13:55:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-28 13:55:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-28 13:55:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-28 13:55:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-28 13:55:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-28 13:55:43,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-28 13:55:43,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-28 13:55:43,862 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:55:43,862 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-28 13:55:43,862 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.290076010630302E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-28 13:55:44,082 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 323 ms to try 5000 different iterations.  Found a solution that moves 23 regions; Going from a computed imbalance of 3.290076010630302E-5 to a new imbalance of 6.905118496010697E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0025555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:55:44,082 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1150485106:83 , srv1316292444:83 , srv1873175972:83 , srv1974430464:83 , srv829537409:83 , srv960316898:83 , srv1004544652:84 , srv1019499159:84 , srv1026817215:84 , srv1052196493:84 , srv1054903366:84 , srv1066678251:84 , srv1079864099:84 , srv1162718199:84 , srv1197714861:84 , srv1213825129:84 , srv1257220618:84 , srv1259822330:84 , srv1282885425:84 , srv1317900390:84 , srv1328337181:84 , srv1390291034:84 , srv1394398735:84 , srv1408603989:84 , srv1484875864:84 , srv1488018765:84 , srv1497923807:84 , srv1504944289:84 , srv1511267901:84 , srv1519417256:84 , srv1536827049:84 , srv1539658042:84 , srv154444050:84 , srv1548475063:84 , srv1601478459:84 , srv1615089000:84 , srv1616878505:84 , srv1625411737:84 , srv1751105946:84 , srv1789281242:84 , srv179590984:84 , srv1813264760:84 , srv1834204196:84 , srv1850731773:84 , srv1857463557:84 , srv1860212734:84 , srv1861574636:84 , srv1912691623:84 , srv1923980981:84 , srv19703260:84 , srv1975879643:84 , srv2036664350:84 , srv2050531730:84 , srv2092203661:84 , srv2103185164:84 , srv2122982110:84 , srv231175281:84 , srv339767931:84 , srv355187434:84 , srv38023450:84 , srv392642651:84 , srv42177756:84 , srv421832969:84 , srv453612644:84 , srv460046373:84 , srv471011305:84 , srv554861524:84 , srv556544944:84 , srv559603534:84 , srv595304284:84 , srv605159594:84 , srv622401858:84 , srv639334406:84 , srv645898968:84 , srv652745841:84 , srv696497426:84 , srv771666592:84 , srv803729788:84 , srv813698372:84 , srv820931025:84 , srv846033244:84 , srv862875448:84 , srv865179656:84 , srv865533267:84 , srv866883697:84 , srv869575607:84 , srv894654718:84 , srv902483253:84 , srv917300342:84 , srv91765144:84 , srv937116477:84 , srv941317897:84 , srv969536791:84 , srv1163763847:85 , srv1436360638:85 , srv1556064985:85 , srv166245152:85 , srv1879605374:85 , srv783607588:85 , srv896287403:684 }
2023-02-28 13:55:44,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-28 13:55:44,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv179590984=40, srv1394398735=19, srv1813264760=41, srv1052196493=3, srv421832969=65, srv1511267901=26, srv969536791=99, srv339767931=60, srv639334406=75, srv1539658042=29, srv471011305=68, srv862875448=86, srv960316898=98, srv865179656=87, srv1504944289=25, srv595304284=72, srv1282885425=14, srv1912691623=49, srv1616878505=35, srv19703260=51, srv1556064985=32, srv1259822330=13, srv392642651=63, srv1601478459=33, srv554861524=69, srv1974430464=52, srv846033244=85, srv1317900390=16, srv355187434=61, srv1390291034=18, srv460046373=67, srv820931025=83, srv829537409=84, srv1615089000=34, srv1789281242=39, srv869575607=90, srv865533267=88, srv917300342=94, srv1861574636=46, srv1257220618=12, srv1625411737=36, srv1162718199=8, srv1488018765=23, srv1484875864=22, srv1026817215=2, srv1834204196=42, srv2036664350=54, srv1328337181=17, srv1163763847=9, srv1316292444=15, srv2103185164=57, srv771666592=79, srv1751105946=38, srv1436360638=21, srv1860212734=45, srv91765144=95, srv1879605374=48, srv803729788=81, srv941317897=97, srv894654718=91, srv1019499159=1, srv166245152=37, srv38023450=62, srv1497923807=24, srv902483253=93, srv937116477=96, srv1923980981=50, srv154444050=30, srv1873175972=47, srv1519417256=27, srv622401858=74, srv1004544652=0, srv1054903366=4, srv2122982110=58, srv783607588=80, srv645898968=76, srv1197714861=10, srv896287403=92, srv605159594=73, srv1857463557=44, srv1408603989=20, srv813698372=82, srv2092203661=56, srv559603534=71, srv1079864099=6, srv556544944=70, srv2050531730=55, srv866883697=89, srv1150485106=7, srv1850731773=43, srv1536827049=28, srv1548475063=31, srv453612644=66, srv652745841=77, srv1066678251=5, srv1975879643=53, srv231175281=59, srv42177756=64, srv696497426=78, srv1213825129=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-28 13:55:44,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-28 13:55:44,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-28 13:55:44,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-28 13:55:44,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-28 13:55:44,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-28 13:55:44,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-28 13:55:44,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-28 13:55:44,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-28 13:55:44,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-28 13:55:44,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-28 13:55:44,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-28 13:55:44,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-28 13:55:44,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-28 13:55:44,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-28 13:55:44,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-28 13:55:44,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-28 13:55:44,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-28 13:55:44,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-28 13:55:44,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-28 13:55:44,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-28 13:55:44,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-28 13:55:44,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-28 13:55:44,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-28 13:55:44,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-28 13:55:44,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-28 13:55:44,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-28 13:55:44,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-28 13:55:44,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-28 13:55:44,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-28 13:55:44,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-28 13:55:44,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-28 13:55:44,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-28 13:55:44,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-28 13:55:44,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-28 13:55:44,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-28 13:55:44,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-28 13:55:44,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-28 13:55:44,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-28 13:55:44,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-28 13:55:44,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-28 13:55:44,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-28 13:55:44,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-28 13:55:44,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-28 13:55:44,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-28 13:55:44,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-28 13:55:44,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-28 13:55:44,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-28 13:55:44,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-28 13:55:44,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-28 13:55:44,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-28 13:55:44,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-28 13:55:44,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-28 13:55:44,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-28 13:55:44,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-28 13:55:44,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-28 13:55:44,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-28 13:55:44,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-28 13:55:44,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-28 13:55:44,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-28 13:55:44,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-28 13:55:44,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-28 13:55:44,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-28 13:55:44,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-28 13:55:44,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-28 13:55:44,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-28 13:55:44,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-28 13:55:44,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-28 13:55:44,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-28 13:55:44,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-28 13:55:44,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-28 13:55:44,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-28 13:55:44,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-28 13:55:44,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-28 13:55:44,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-28 13:55:44,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-28 13:55:44,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-28 13:55:44,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-28 13:55:44,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-28 13:55:44,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-28 13:55:44,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-28 13:55:44,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-28 13:55:44,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-28 13:55:44,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-28 13:55:44,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-28 13:55:44,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-28 13:55:44,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-28 13:55:44,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-28 13:55:44,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-28 13:55:44,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-28 13:55:44,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-28 13:55:44,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-28 13:55:44,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-28 13:55:44,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-28 13:55:44,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-28 13:55:44,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-28 13:55:44,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-28 13:55:44,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-28 13:55:44,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-28 13:55:44,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-28 13:55:44,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-28 13:55:44,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-28 13:55:44,214 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:55:44,214 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1150485106:83 , srv1316292444:83 , srv1873175972:83 , srv1974430464:83 , srv829537409:83 , srv960316898:83 , srv1004544652:84 , srv1019499159:84 , srv1026817215:84 , srv1052196493:84 , srv1054903366:84 , srv1066678251:84 , srv1079864099:84 , srv1162718199:84 , srv1197714861:84 , srv1213825129:84 , srv1257220618:84 , srv1259822330:84 , srv1282885425:84 , srv1317900390:84 , srv1328337181:84 , srv1390291034:84 , srv1394398735:84 , srv1408603989:84 , srv1484875864:84 , srv1488018765:84 , srv1497923807:84 , srv1504944289:84 , srv1511267901:84 , srv1519417256:84 , srv1536827049:84 , srv1539658042:84 , srv154444050:84 , srv1548475063:84 , srv1601478459:84 , srv1615089000:84 , srv1616878505:84 , srv1625411737:84 , srv1751105946:84 , srv1789281242:84 , srv179590984:84 , srv1813264760:84 , srv1834204196:84 , srv1850731773:84 , srv1857463557:84 , srv1860212734:84 , srv1861574636:84 , srv1912691623:84 , srv1923980981:84 , srv19703260:84 , srv1975879643:84 , srv2036664350:84 , srv2050531730:84 , srv2092203661:84 , srv2103185164:84 , srv2122982110:84 , srv231175281:84 , srv339767931:84 , srv355187434:84 , srv38023450:84 , srv392642651:84 , srv42177756:84 , srv421832969:84 , srv453612644:84 , srv460046373:84 , srv471011305:84 , srv554861524:84 , srv556544944:84 , srv559603534:84 , srv595304284:84 , srv605159594:84 , srv622401858:84 , srv639334406:84 , srv645898968:84 , srv652745841:84 , srv696497426:84 , srv771666592:84 , srv803729788:84 , srv813698372:84 , srv820931025:84 , srv846033244:84 , srv862875448:84 , srv865179656:84 , srv865533267:84 , srv866883697:84 , srv869575607:84 , srv894654718:84 , srv902483253:84 , srv917300342:84 , srv91765144:84 , srv937116477:84 , srv941317897:84 , srv969536791:84 , srv1163763847:85 , srv1436360638:85 , srv1556064985:85 , srv166245152:85 , srv1879605374:85 , srv783607588:85 , srv896287403:684 }
2023-02-28 13:55:44,253 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=352 (was 286) - SystemLoadAverage LEAK? -, ProcessCount=164 (was 164), AvailableMemoryMB=4952 (was 5484)
2023-02-28 13:55:44,264 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=352, ProcessCount=164, AvailableMemoryMB=4951
2023-02-28 13:55:44,265 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-28 13:55:44,266 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-28 13:55:44,281 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1049364210:84 , srv1059526758:84 , srv1093481955:84 , srv1126047549:84 , srv1143446403:84 , srv1258956077:84 , srv1304308211:84 , srv1370444470:84 , srv1479105305:84 , srv1483244488:84 , srv1556261256:84 , srv1631129909:84 , srv1726160767:84 , srv1752703912:84 , srv2007881370:84 , srv2105070406:84 , srv2107003513:84 , srv267885622:84 , srv313395976:84 , srv534487215:84 , srv569480047:84 , srv699957310:84 , srv741828410:84 , srv74185701:84 , srv849771649:84 , srv870637433:84 , srv881123749:84 , srv885512287:84 , srv977681017:84 , srv1860017924:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-28 13:55:44,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-28 13:55:44,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1304308211=6, srv849771649=25, srv1143446403=4, srv1631129909=11, srv1370444470=7, srv1049364210=0, srv1059526758=1, srv1752703912=13, srv699957310=22, srv2007881370=15, srv1093481955=2, srv1726160767=12, srv741828410=23, srv1258956077=5, srv881123749=27, srv870637433=26, srv2107003513=17, srv885512287=28, srv1483244488=9, srv1479105305=8, srv267885622=18, srv977681017=29, srv1556261256=10, srv2105070406=16, srv74185701=24, srv1860017924=14, srv1126047549=3, srv534487215=20, srv313395976=19, srv569480047=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-28 13:55:44,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-28 13:55:44,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-28 13:55:44,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-28 13:55:44,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-28 13:55:44,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-28 13:55:44,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-28 13:55:44,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-28 13:55:44,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-28 13:55:44,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-28 13:55:44,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-28 13:55:44,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-28 13:55:44,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-28 13:55:44,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-28 13:55:44,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-28 13:55:44,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-28 13:55:44,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-28 13:55:44,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-28 13:55:44,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-28 13:55:44,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-28 13:55:44,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-28 13:55:44,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-28 13:55:44,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-28 13:55:44,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-28 13:55:44,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-28 13:55:44,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-28 13:55:44,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-28 13:55:44,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-28 13:55:44,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-28 13:55:44,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-28 13:55:44,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-28 13:55:44,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-28 13:55:44,321 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.036290038132629, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:55:44,321 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912307391989459, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.036290038132629, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-28 13:57:44,303 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9265255 different iterations.  Found a solution that moves 1840 regions; Going from a computed imbalance of 0.9912307391989459 to a new imbalance of 4.2946517914333035E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6814814814814815, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:57:44,310 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1049364210:90 , srv1059526758:90 , srv1093481955:90 , srv1126047549:90 , srv1143446403:90 , srv1258956077:90 , srv1304308211:90 , srv1370444470:90 , srv1479105305:90 , srv1483244488:90 , srv1556261256:90 , srv1631129909:90 , srv1726160767:90 , srv1752703912:90 , srv1860017924:90 , srv2007881370:90 , srv2105070406:90 , srv2107003513:90 , srv267885622:90 , srv313395976:90 , srv534487215:90 , srv569480047:90 , srv699957310:90 , srv741828410:90 , srv74185701:90 , srv849771649:90 , srv870637433:90 , srv881123749:90 , srv885512287:90 , srv977681017:90 }
2023-02-28 13:57:44,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-28 13:57:44,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1304308211=6, srv849771649=25, srv1143446403=4, srv1631129909=11, srv1370444470=7, srv1049364210=0, srv1059526758=1, srv1752703912=13, srv699957310=22, srv2007881370=15, srv1093481955=2, srv1726160767=12, srv741828410=23, srv1258956077=5, srv881123749=27, srv870637433=26, srv2107003513=17, srv885512287=28, srv1483244488=9, srv1479105305=8, srv267885622=18, srv977681017=29, srv1556261256=10, srv2105070406=16, srv74185701=24, srv1860017924=14, srv1126047549=3, srv534487215=20, srv313395976=19, srv569480047=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-28 13:57:44,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-28 13:57:44,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-28 13:57:44,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-28 13:57:44,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-28 13:57:44,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-28 13:57:44,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-28 13:57:44,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-28 13:57:44,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-28 13:57:44,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-28 13:57:44,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-28 13:57:44,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-28 13:57:44,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-28 13:57:44,329 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-28 13:57:44,329 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1049364210:90 , srv1059526758:90 , srv1093481955:90 , srv1126047549:90 , srv1143446403:90 , srv1258956077:90 , srv1304308211:90 , srv1370444470:90 , srv1479105305:90 , srv1483244488:90 , srv1556261256:90 , srv1631129909:90 , srv1726160767:90 , srv1752703912:90 , srv1860017924:90 , srv2007881370:90 , srv2105070406:90 , srv2107003513:90 , srv267885622:90 , srv313395976:90 , srv534487215:90 , srv569480047:90 , srv699957310:90 , srv741828410:90 , srv74185701:90 , srv849771649:90 , srv870637433:90 , srv881123749:90 , srv885512287:90 , srv977681017:90 }
2023-02-28 13:57:44,342 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=147 (was 352), ProcessCount=165 (was 164) - ProcessCount LEAK? -, AvailableMemoryMB=5135 (was 4951) - AvailableMemoryMB LEAK? -