2023-02-08 02:53:00,989 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-08 02:53:01,301 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-08 02:53:01,403 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-08 02:53:01,460 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-08 02:53:01,466 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-08 02:53:01,481 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=245, ProcessCount=173, AvailableMemoryMB=4993
2023-02-08 02:53:01,483 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-08 02:53:01,484 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-08 02:53:01,626 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009040808:84 , srv1025366973:84 , srv1032937838:84 , srv103911323:84 , srv1080970169:84 , srv1099331842:84 , srv1108350021:84 , srv1110862157:84 , srv1115319951:84 , srv1116776370:84 , srv1116779024:84 , srv1133467521:84 , srv1217804328:84 , srv122832308:84 , srv1230336724:84 , srv1340268596:84 , srv135085779:84 , srv1352884383:84 , srv1370970527:84 , srv1439967086:84 , srv1455882751:84 , srv1463603809:84 , srv1465183598:84 , srv1488678929:84 , srv1493023847:84 , srv1501948783:84 , srv150585303:84 , srv151276868:84 , srv1517900379:84 , srv1523610958:84 , srv1553449624:84 , srv1586013587:84 , srv1599219048:84 , srv1631612267:84 , srv1635252678:84 , srv163947051:84 , srv1647070779:84 , srv164879844:84 , srv1673477254:84 , srv1679615747:84 , srv1697525715:84 , srv171296603:84 , srv1785312503:84 , srv1862535845:84 , srv1870706549:84 , srv1897961096:84 , srv1916191985:84 , srv1928348576:84 , srv1931207603:84 , srv1953446602:84 , srv1959649113:84 , srv1977467432:84 , srv2033369524:84 , srv2035265240:84 , srv2111077148:84 , srv2139876957:84 , srv247148259:84 , srv251265266:84 , srv252031952:84 , srv263894148:84 , srv297824476:84 , srv307566691:84 , srv314427611:84 , srv317117159:84 , srv322831332:84 , srv397586077:84 , srv437429001:84 , srv445071434:84 , srv45116468:84 , srv458675373:84 , srv461522617:84 , srv47598987:84 , srv517739439:84 , srv550249083:84 , srv583670124:84 , srv586540973:84 , srv597547438:84 , srv60961063:84 , srv614087704:84 , srv631442302:84 , srv659764399:84 , srv667172334:84 , srv679534316:84 , srv685437756:84 , srv689484325:84 , srv701263736:84 , srv708072678:84 , srv723655242:84 , srv74612556:84 , srv801964601:84 , srv839761303:84 , srv85827550:84 , srv903515295:84 , srv935772927:84 , srv941961122:84 , srv951750510:84 , srv977132166:84 , srv984981266:84 , srv987820047:84 , srv145966147:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-08 02:53:01,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 02:53:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv252031952=59, srv941961122=95, srv1116779024=10, srv667172334=82, srv631442302=80, srv2035265240=54, srv614087704=79, srv1673477254=39, srv60961063=78, srv583670124=75, srv45116468=69, srv801964601=90, srv1025366973=1, srv437429001=67, srv1586013587=32, srv708072678=87, srv458675373=70, srv461522617=71, srv2139876957=56, srv1099331842=5, srv1862535845=44, srv1108350021=6, srv314427611=63, srv1009040808=0, srv1599219048=33, srv1931207603=49, srv164879844=38, srv1110862157=7, srv135085779=16, srv1916191985=47, srv47598987=72, srv1897961096=46, srv1959649113=51, srv322831332=65, srv1217804328=12, srv1501948783=26, srv1647070779=37, srv263894148=60, srv74612556=89, srv103911323=3, srv1953446602=50, srv171296603=42, srv984981266=98, srv2033369524=53, srv977132166=97, srv597547438=77, srv85827550=92, srv586540973=76, srv987820047=99, srv1493023847=25, srv839761303=91, srv935772927=94, srv307566691=62, srv723655242=88, srv1340268596=15, srv1352884383=17, srv1517900379=29, srv1697525715=41, srv1370970527=18, srv1635252678=35, srv1488678929=24, srv1785312503=43, srv517739439=73, srv145966147=21, srv1928348576=48, srv685437756=84, srv1463603809=22, srv397586077=66, srv550249083=74, srv701263736=86, srv1115319951=8, srv1439967086=19, srv150585303=27, srv247148259=57, srv659764399=81, srv689484325=85, srv1455882751=20, srv1133467521=11, srv151276868=28, srv951750510=96, srv1465183598=23, srv1631612267=34, srv297824476=61, srv1032937838=2, srv1553449624=31, srv163947051=36, srv1870706549=45, srv1116776370=9, srv1230336724=14, srv122832308=13, srv1523610958=30, srv1080970169=4, srv251265266=58, srv679534316=83, srv1679615747=40, srv1977467432=52, srv903515295=93, srv445071434=68, srv317117159=64, srv2111077148=55} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 02:53:01,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 02:53:01,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 02:53:01,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 02:53:01,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 02:53:01,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 02:53:01,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 02:53:01,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 02:53:01,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 02:53:01,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 02:53:01,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 02:53:01,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 02:53:01,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 02:53:01,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 02:53:01,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 02:53:01,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 02:53:01,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 02:53:01,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 02:53:01,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 02:53:01,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 02:53:01,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 02:53:01,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 02:53:01,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 02:53:01,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 02:53:01,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 02:53:01,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 02:53:01,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 02:53:01,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 02:53:01,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 02:53:01,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 02:53:01,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 02:53:01,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-08 02:53:01,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-08 02:53:01,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-08 02:53:01,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-08 02:53:01,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-08 02:53:01,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-08 02:53:01,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-08 02:53:01,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-08 02:53:01,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-08 02:53:01,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-08 02:53:01,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-08 02:53:01,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-08 02:53:01,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-08 02:53:01,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-08 02:53:01,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-08 02:53:01,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-08 02:53:01,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-08 02:53:01,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-08 02:53:01,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-08 02:53:01,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-08 02:53:01,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-08 02:53:01,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-08 02:53:01,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-08 02:53:01,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-08 02:53:01,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-08 02:53:01,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-08 02:53:01,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-08 02:53:01,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-08 02:53:01,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-08 02:53:01,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-08 02:53:01,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-08 02:53:01,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-08 02:53:01,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-08 02:53:01,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-08 02:53:01,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-08 02:53:01,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-08 02:53:01,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-08 02:53:01,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-08 02:53:01,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-08 02:53:01,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-08 02:53:01,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-08 02:53:01,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-08 02:53:01,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-08 02:53:01,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-08 02:53:01,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-08 02:53:01,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-08 02:53:01,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-08 02:53:01,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-08 02:53:01,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-08 02:53:01,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-08 02:53:01,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-08 02:53:01,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-08 02:53:01,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-08 02:53:01,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-08 02:53:01,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-08 02:53:01,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-08 02:53:01,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-08 02:53:01,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-08 02:53:01,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-08 02:53:01,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-08 02:53:01,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-08 02:53:01,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-08 02:53:01,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-08 02:53:01,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-08 02:53:01,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-08 02:53:01,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-08 02:53:01,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-08 02:53:01,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-08 02:53:01,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-08 02:53:01,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-08 02:53:01,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-08 02:53:02,200 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:53:02,200 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-08 02:53:02,201 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-08 02:53:02,545 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 773 ms to try 5000 different iterations.  Found a solution that moves 4679 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18227329403540132. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039373444264263646, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05333333333333333, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5198888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039373444264263646, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1775, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:53:02,563 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1110862157:81 , srv1463603809:82 , srv171296603:82 , srv667172334:82 , srv1455882751:83 , srv1465183598:83 , srv2111077148:83 , srv297824476:83 , srv801964601:83 , srv935772927:83 , srv1080970169:84 , srv135085779:84 , srv1501948783:84 , srv1673477254:84 , srv322831332:84 , srv458675373:84 , srv47598987:84 , srv586540973:84 , srv903515295:84 , srv941961122:84 , srv103911323:85 , srv1115319951:85 , srv1116776370:85 , srv1439967086:85 , srv1493023847:85 , srv151276868:85 , srv1517900379:85 , srv1523610958:85 , srv1635252678:85 , srv1679615747:85 , srv1697525715:85 , srv1785312503:85 , srv1862535845:85 , srv1897961096:85 , srv1916191985:85 , srv1953446602:85 , srv583670124:85 , srv631442302:85 , srv1032937838:86 , srv1099331842:86 , srv1217804328:86 , srv122832308:86 , srv1352884383:86 , srv150585303:86 , srv163947051:86 , srv1977467432:86 , srv247148259:86 , srv252031952:86 , srv263894148:86 , srv307566691:86 , srv461522617:86 , srv60961063:86 , srv85827550:86 , srv987820047:86 , srv1009040808:87 , srv1133467521:87 , srv1370970527:87 , srv1931207603:87 , srv1959649113:87 , srv314427611:87 , srv397586077:87 , srv659764399:87 , srv679534316:87 , srv701263736:87 , srv951750510:87 , srv984981266:87 , srv1116779024:88 , srv1488678929:88 , srv1586013587:88 , srv1631612267:88 , srv2035265240:88 , srv437429001:88 , srv45116468:88 , srv517739439:88 , srv685437756:88 , srv689484325:88 , srv723655242:88 , srv1553449624:89 , srv1599219048:89 , srv164879844:89 , srv2139876957:89 , srv251265266:89 , srv317117159:89 , srv550249083:89 , srv614087704:89 , srv708072678:89 , srv74612556:89 , srv977132166:89 , srv1647070779:90 , srv1928348576:90 , srv2033369524:90 , srv445071434:90 , srv597547438:90 , srv839761303:90 , srv1025366973:91 , srv1108350021:91 , srv1340268596:91 , srv1870706549:91 , srv1230336724:94 , srv145966147:440 }
2023-02-08 02:53:02,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 02:53:02,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv252031952=59, srv941961122=95, srv1116779024=10, srv667172334=82, srv631442302=80, srv2035265240=54, srv614087704=79, srv1673477254=39, srv60961063=78, srv583670124=75, srv45116468=69, srv801964601=90, srv1025366973=1, srv437429001=67, srv1586013587=32, srv708072678=87, srv458675373=70, srv461522617=71, srv2139876957=56, srv1099331842=5, srv1862535845=44, srv1108350021=6, srv314427611=63, srv1009040808=0, srv1599219048=33, srv1931207603=49, srv164879844=38, srv1110862157=7, srv135085779=16, srv1916191985=47, srv47598987=72, srv1897961096=46, srv1959649113=51, srv322831332=65, srv1217804328=12, srv1501948783=26, srv1647070779=37, srv263894148=60, srv74612556=89, srv103911323=3, srv1953446602=50, srv171296603=42, srv984981266=98, srv2033369524=53, srv977132166=97, srv597547438=77, srv85827550=92, srv586540973=76, srv987820047=99, srv1493023847=25, srv839761303=91, srv935772927=94, srv307566691=62, srv723655242=88, srv1340268596=15, srv1352884383=17, srv1517900379=29, srv1697525715=41, srv1370970527=18, srv1635252678=35, srv1488678929=24, srv1785312503=43, srv517739439=73, srv145966147=21, srv1928348576=48, srv685437756=84, srv1463603809=22, srv397586077=66, srv550249083=74, srv701263736=86, srv1115319951=8, srv1439967086=19, srv150585303=27, srv247148259=57, srv659764399=81, srv689484325=85, srv1455882751=20, srv1133467521=11, srv151276868=28, srv951750510=96, srv1465183598=23, srv1631612267=34, srv297824476=61, srv1032937838=2, srv1553449624=31, srv163947051=36, srv1870706549=45, srv1116776370=9, srv1230336724=14, srv122832308=13, srv1523610958=30, srv1080970169=4, srv251265266=58, srv679534316=83, srv1679615747=40, srv1977467432=52, srv903515295=93, srv445071434=68, srv317117159=64, srv2111077148=55} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 02:53:02,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 02:53:02,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 02:53:02,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 02:53:02,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 02:53:02,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 02:53:02,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 02:53:02,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 02:53:02,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 02:53:02,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 02:53:02,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 02:53:02,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 02:53:02,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 02:53:02,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 02:53:02,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 02:53:02,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 02:53:02,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 02:53:02,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 02:53:02,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 02:53:02,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 02:53:02,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 02:53:02,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 02:53:02,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 02:53:02,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 02:53:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 02:53:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 02:53:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 02:53:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 02:53:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 02:53:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 02:53:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 02:53:02,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-08 02:53:02,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-08 02:53:02,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-08 02:53:02,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-08 02:53:02,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-08 02:53:02,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-08 02:53:02,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-08 02:53:02,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-08 02:53:02,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-08 02:53:02,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-08 02:53:02,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-08 02:53:02,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-08 02:53:02,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-08 02:53:02,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-08 02:53:02,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-08 02:53:02,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-08 02:53:02,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-08 02:53:02,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-08 02:53:02,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-08 02:53:02,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-08 02:53:02,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-08 02:53:02,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-08 02:53:02,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-08 02:53:02,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-08 02:53:02,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-08 02:53:02,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-08 02:53:02,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-08 02:53:02,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-08 02:53:02,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-08 02:53:02,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-08 02:53:02,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-08 02:53:02,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-08 02:53:02,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-08 02:53:02,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-08 02:53:02,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-08 02:53:02,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-08 02:53:02,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-08 02:53:02,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-08 02:53:02,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-08 02:53:02,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-08 02:53:02,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-08 02:53:02,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-08 02:53:02,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-08 02:53:02,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-08 02:53:02,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-08 02:53:02,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-08 02:53:02,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-08 02:53:02,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-08 02:53:02,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-08 02:53:02,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-08 02:53:02,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-08 02:53:02,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-08 02:53:02,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-08 02:53:02,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-08 02:53:02,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-08 02:53:02,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-08 02:53:02,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-08 02:53:02,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-08 02:53:02,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-08 02:53:02,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-08 02:53:02,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-08 02:53:02,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-08 02:53:02,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-08 02:53:02,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-08 02:53:02,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-08 02:53:02,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-08 02:53:02,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-08 02:53:02,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-08 02:53:02,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-08 02:53:02,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-08 02:53:02,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-08 02:53:02,716 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039373444264263646, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05333333333333333, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039373444264263646, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1775, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:53:02,716 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-08 02:53:02,717 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1822405309771424, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039373444264263646, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05333333333333333, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039373444264263646, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1775, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-08 02:53:02,939 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 313 ms to try 5000 different iterations.  Found a solution that moves 2690 regions; Going from a computed imbalance of 0.1822405309771424 to a new imbalance of 0.015177924925349907. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02047448142383); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030744594298240654, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29888888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02047448142383); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:53:02,947 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1230336724:77 , srv1025366973:80 , srv1928348576:80 , srv1108350021:81 , srv1340268596:81 , srv1870706549:81 , srv2033369524:81 , srv1553449624:82 , srv437429001:82 , srv1488678929:83 , srv1599219048:83 , srv1631612267:83 , srv1647070779:83 , srv164879844:83 , srv2139876957:83 , srv251265266:83 , srv614087704:83 , srv689484325:83 , srv708072678:83 , srv74612556:83 , srv977132166:83 , srv1009040808:84 , srv1116779024:84 , srv1352884383:84 , srv1586013587:84 , srv314427611:84 , srv517739439:84 , srv597547438:84 , srv701263736:84 , srv839761303:84 , srv951750510:84 , srv984981266:84 , srv1133467521:85 , srv1679615747:85 , srv252031952:85 , srv263894148:85 , srv397586077:85 , srv445071434:85 , srv45116468:85 , srv550249083:85 , srv1099331842:86 , srv1217804328:86 , srv122832308:86 , srv1370970527:86 , srv1501948783:86 , srv151276868:86 , srv1635252678:86 , srv1697525715:86 , srv1785312503:86 , srv1931207603:86 , srv1977467432:86 , srv247148259:86 , srv317117159:86 , srv322831332:86 , srv461522617:86 , srv583670124:86 , srv659764399:86 , srv679534316:86 , srv723655242:86 , srv85827550:86 , srv987820047:86 , srv103911323:87 , srv1115319951:87 , srv1465183598:87 , srv1493023847:87 , srv150585303:87 , srv1523610958:87 , srv1862535845:87 , srv1897961096:87 , srv1916191985:87 , srv1959649113:87 , srv2035265240:87 , srv307566691:87 , srv458675373:87 , srv60961063:87 , srv685437756:87 , srv1032937838:88 , srv1116776370:88 , srv1439967086:88 , srv47598987:88 , srv631442302:88 , srv941961122:88 , srv1080970169:89 , srv1110862157:89 , srv1463603809:89 , srv1517900379:89 , srv163947051:89 , srv1673477254:89 , srv1953446602:89 , srv2111077148:89 , srv667172334:89 , srv801964601:89 , srv135085779:90 , srv1455882751:90 , srv171296603:90 , srv297824476:90 , srv586540973:90 , srv903515295:90 , srv935772927:90 , srv145966147:516 }
2023-02-08 02:53:02,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 02:53:02,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv252031952=59, srv941961122=95, srv1116779024=10, srv667172334=82, srv631442302=80, srv2035265240=54, srv614087704=79, srv1673477254=39, srv60961063=78, srv583670124=75, srv45116468=69, srv801964601=90, srv1025366973=1, srv437429001=67, srv1586013587=32, srv708072678=87, srv458675373=70, srv461522617=71, srv2139876957=56, srv1099331842=5, srv1862535845=44, srv1108350021=6, srv314427611=63, srv1009040808=0, srv1599219048=33, srv1931207603=49, srv164879844=38, srv1110862157=7, srv135085779=16, srv1916191985=47, srv47598987=72, srv1897961096=46, srv1959649113=51, srv322831332=65, srv1217804328=12, srv1501948783=26, srv1647070779=37, srv263894148=60, srv74612556=89, srv103911323=3, srv1953446602=50, srv171296603=42, srv984981266=98, srv2033369524=53, srv977132166=97, srv597547438=77, srv85827550=92, srv586540973=76, srv987820047=99, srv1493023847=25, srv839761303=91, srv935772927=94, srv307566691=62, srv723655242=88, srv1340268596=15, srv1352884383=17, srv1517900379=29, srv1697525715=41, srv1370970527=18, srv1635252678=35, srv1488678929=24, srv1785312503=43, srv517739439=73, srv145966147=21, srv1928348576=48, srv685437756=84, srv1463603809=22, srv397586077=66, srv550249083=74, srv701263736=86, srv1115319951=8, srv1439967086=19, srv150585303=27, srv247148259=57, srv659764399=81, srv689484325=85, srv1455882751=20, srv1133467521=11, srv151276868=28, srv951750510=96, srv1465183598=23, srv1631612267=34, srv297824476=61, srv1032937838=2, srv1553449624=31, srv163947051=36, srv1870706549=45, srv1116776370=9, srv1230336724=14, srv122832308=13, srv1523610958=30, srv1080970169=4, srv251265266=58, srv679534316=83, srv1679615747=40, srv1977467432=52, srv903515295=93, srv445071434=68, srv317117159=64, srv2111077148=55} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 02:53:02,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 02:53:02,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 02:53:02,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 02:53:02,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 02:53:02,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 02:53:02,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 02:53:02,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 02:53:02,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 02:53:02,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 02:53:02,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 02:53:02,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 02:53:02,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 02:53:02,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 02:53:02,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 02:53:02,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 02:53:02,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 02:53:02,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 02:53:02,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-08 02:53:02,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-08 02:53:02,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-08 02:53:02,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-08 02:53:02,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-08 02:53:02,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-08 02:53:02,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-08 02:53:02,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-08 02:53:02,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-08 02:53:02,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-08 02:53:02,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-08 02:53:02,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-08 02:53:02,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-08 02:53:02,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-08 02:53:02,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-08 02:53:02,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-08 02:53:02,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-08 02:53:02,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-08 02:53:02,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-08 02:53:02,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-08 02:53:02,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-08 02:53:02,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-08 02:53:02,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-08 02:53:02,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-08 02:53:02,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-08 02:53:02,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-08 02:53:02,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-08 02:53:03,062 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02047448142383); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030744594298240654, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02047448142383); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:53:03,062 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-08 02:53:03,063 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015159089142764653, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02047448142383); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030744594298240654, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02047448142383); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-08 02:53:03,243 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 259 ms to try 5000 different iterations.  Found a solution that moves 984 regions; Going from a computed imbalance of 0.015159089142764653 to a new imbalance of 6.835890660492889E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005994968168977276); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010583429438308044); MoveCostFunction : (multiplier=7.0, imbalance=0.10933333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005994968168977276); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:53:03,244 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv163947051:81 , srv317117159:82 , srv445071434:82 , srv135085779:83 , srv1517900379:83 , srv1959649113:83 , srv685437756:83 , srv903515295:83 , srv1032937838:84 , srv1080970169:84 , srv1370970527:84 , srv1455882751:84 , srv150585303:84 , srv1870706549:84 , srv1953446602:84 , srv2035265240:84 , srv247148259:84 , srv297824476:84 , srv307566691:84 , srv45116468:84 , srv550249083:84 , srv586540973:84 , srv597547438:84 , srv679534316:84 , srv839761303:84 , srv103911323:85 , srv1099331842:85 , srv1116776370:85 , srv1116779024:85 , srv1133467521:85 , srv1523610958:85 , srv1599219048:85 , srv1647070779:85 , srv164879844:85 , srv171296603:85 , srv1897961096:85 , srv1916191985:85 , srv1931207603:85 , srv1977467432:85 , srv2111077148:85 , srv251265266:85 , srv314427611:85 , srv461522617:85 , srv517739439:85 , srv60961063:85 , srv631442302:85 , srv659764399:85 , srv667172334:85 , srv723655242:85 , srv935772927:85 , srv941961122:85 , srv977132166:85 , srv1025366973:86 , srv1108350021:86 , srv1115319951:86 , srv1217804328:86 , srv122832308:86 , srv1230336724:86 , srv1340268596:86 , srv1439967086:86 , srv1488678929:86 , srv1493023847:86 , srv151276868:86 , srv1586013587:86 , srv1631612267:86 , srv1635252678:86 , srv1673477254:86 , srv1862535845:86 , srv2033369524:86 , srv2139876957:86 , srv252031952:86 , srv397586077:86 , srv614087704:86 , srv689484325:86 , srv708072678:86 , srv74612556:86 , srv801964601:86 , srv85827550:86 , srv951750510:86 , srv984981266:86 , srv987820047:86 , srv1009040808:87 , srv1110862157:87 , srv1352884383:87 , srv1463603809:87 , srv1501948783:87 , srv1553449624:87 , srv1679615747:87 , srv1697525715:87 , srv1785312503:87 , srv1928348576:87 , srv263894148:87 , srv322831332:87 , srv458675373:87 , srv47598987:87 , srv583670124:87 , srv701263736:87 , srv1465183598:88 , srv437429001:88 , srv145966147:555 }
2023-02-08 02:53:03,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 02:53:03,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv252031952=59, srv941961122=95, srv1116779024=10, srv667172334=82, srv631442302=80, srv2035265240=54, srv614087704=79, srv1673477254=39, srv60961063=78, srv583670124=75, srv45116468=69, srv801964601=90, srv1025366973=1, srv437429001=67, srv1586013587=32, srv708072678=87, srv458675373=70, srv461522617=71, srv2139876957=56, srv1099331842=5, srv1862535845=44, srv1108350021=6, srv314427611=63, srv1009040808=0, srv1599219048=33, srv1931207603=49, srv164879844=38, srv1110862157=7, srv135085779=16, srv1916191985=47, srv47598987=72, srv1897961096=46, srv1959649113=51, srv322831332=65, srv1217804328=12, srv1501948783=26, srv1647070779=37, srv263894148=60, srv74612556=89, srv103911323=3, srv1953446602=50, srv171296603=42, srv984981266=98, srv2033369524=53, srv977132166=97, srv597547438=77, srv85827550=92, srv586540973=76, srv987820047=99, srv1493023847=25, srv839761303=91, srv935772927=94, srv307566691=62, srv723655242=88, srv1340268596=15, srv1352884383=17, srv1517900379=29, srv1697525715=41, srv1370970527=18, srv1635252678=35, srv1488678929=24, srv1785312503=43, srv517739439=73, srv145966147=21, srv1928348576=48, srv685437756=84, srv1463603809=22, srv397586077=66, srv550249083=74, srv701263736=86, srv1115319951=8, srv1439967086=19, srv150585303=27, srv247148259=57, srv659764399=81, srv689484325=85, srv1455882751=20, srv1133467521=11, srv151276868=28, srv951750510=96, srv1465183598=23, srv1631612267=34, srv297824476=61, srv1032937838=2, srv1553449624=31, srv163947051=36, srv1870706549=45, srv1116776370=9, srv1230336724=14, srv122832308=13, srv1523610958=30, srv1080970169=4, srv251265266=58, srv679534316=83, srv1679615747=40, srv1977467432=52, srv903515295=93, srv445071434=68, srv317117159=64, srv2111077148=55} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 02:53:03,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 02:53:03,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 02:53:03,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 02:53:03,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 02:53:03,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 02:53:03,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 02:53:03,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 02:53:03,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 02:53:03,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 02:53:03,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 02:53:03,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 02:53:03,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 02:53:03,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 02:53:03,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-08 02:53:03,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-08 02:53:03,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-08 02:53:03,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-08 02:53:03,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-08 02:53:03,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-08 02:53:03,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-08 02:53:03,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-08 02:53:03,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-08 02:53:03,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-08 02:53:03,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-08 02:53:03,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-08 02:53:03,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-08 02:53:03,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-08 02:53:03,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-08 02:53:03,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-08 02:53:03,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-08 02:53:03,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-08 02:53:03,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-08 02:53:03,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-08 02:53:03,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-08 02:53:03,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-08 02:53:03,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-08 02:53:03,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-08 02:53:03,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-08 02:53:03,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-08 02:53:03,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-08 02:53:03,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-08 02:53:03,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-08 02:53:03,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-08 02:53:03,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-08 02:53:03,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-08 02:53:03,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-08 02:53:03,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-08 02:53:03,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-08 02:53:03,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-08 02:53:03,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-08 02:53:03,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-08 02:53:03,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-08 02:53:03,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-08 02:53:03,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-08 02:53:03,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-08 02:53:03,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-08 02:53:03,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-08 02:53:03,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-08 02:53:03,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-08 02:53:03,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-08 02:53:03,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-08 02:53:03,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-08 02:53:03,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-08 02:53:03,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-08 02:53:03,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-08 02:53:03,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-08 02:53:03,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-08 02:53:03,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-08 02:53:03,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-08 02:53:03,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-08 02:53:03,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-08 02:53:03,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-08 02:53:03,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-08 02:53:03,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-08 02:53:03,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-08 02:53:03,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-08 02:53:03,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-08 02:53:03,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-08 02:53:03,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-08 02:53:03,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-08 02:53:03,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-08 02:53:03,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-08 02:53:03,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-08 02:53:03,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-08 02:53:03,356 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005994968168977276); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010583429438308044); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005994968168977276); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:53:03,357 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-08 02:53:03,357 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.766989507839026E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005994968168977276); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010583429438308044); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005994968168977276); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-08 02:53:03,588 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 315 ms to try 5000 different iterations.  Found a solution that moves 247 regions; Going from a computed imbalance of 6.766989507839026E-4 to a new imbalance of 4.14192976940547E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.027444444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:53:03,589 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1032937838:83 , srv1439967086:83 , srv1673477254:83 , srv2035265240:83 , srv47598987:83 , srv723655242:83 , srv1009040808:84 , srv1099331842:84 , srv1108350021:84 , srv1115319951:84 , srv1116776370:84 , srv1217804328:84 , srv122832308:84 , srv1463603809:84 , srv1465183598:84 , srv1493023847:84 , srv1501948783:84 , srv1586013587:84 , srv1635252678:84 , srv1647070779:84 , srv1697525715:84 , srv1785312503:84 , srv1862535845:84 , srv1931207603:84 , srv1953446602:84 , srv2139876957:84 , srv263894148:84 , srv397586077:84 , srv437429001:84 , srv45116468:84 , srv458675373:84 , srv550249083:84 , srv583670124:84 , srv586540973:84 , srv597547438:84 , srv60961063:84 , srv614087704:84 , srv659764399:84 , srv685437756:84 , srv701263736:84 , srv708072678:84 , srv74612556:84 , srv801964601:84 , srv839761303:84 , srv935772927:84 , srv987820047:84 , srv1025366973:85 , srv1080970169:85 , srv1110862157:85 , srv1116779024:85 , srv1133467521:85 , srv1230336724:85 , srv1340268596:85 , srv135085779:85 , srv1352884383:85 , srv1370970527:85 , srv1455882751:85 , srv1488678929:85 , srv150585303:85 , srv151276868:85 , srv1517900379:85 , srv1523610958:85 , srv1553449624:85 , srv1599219048:85 , srv1631612267:85 , srv164879844:85 , srv1679615747:85 , srv171296603:85 , srv1897961096:85 , srv1916191985:85 , srv1928348576:85 , srv1959649113:85 , srv1977467432:85 , srv2033369524:85 , srv2111077148:85 , srv251265266:85 , srv252031952:85 , srv297824476:85 , srv307566691:85 , srv317117159:85 , srv322831332:85 , srv445071434:85 , srv461522617:85 , srv517739439:85 , srv631442302:85 , srv679534316:85 , srv689484325:85 , srv85827550:85 , srv903515295:85 , srv941961122:85 , srv951750510:85 , srv977132166:85 , srv984981266:85 , srv103911323:86 , srv163947051:86 , srv1870706549:86 , srv247148259:86 , srv314427611:86 , srv667172334:86 , srv145966147:631 }
2023-02-08 02:53:03,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 02:53:03,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv252031952=59, srv941961122=95, srv1116779024=10, srv667172334=82, srv631442302=80, srv2035265240=54, srv614087704=79, srv1673477254=39, srv60961063=78, srv583670124=75, srv45116468=69, srv801964601=90, srv1025366973=1, srv437429001=67, srv1586013587=32, srv708072678=87, srv458675373=70, srv461522617=71, srv2139876957=56, srv1099331842=5, srv1862535845=44, srv1108350021=6, srv314427611=63, srv1009040808=0, srv1599219048=33, srv1931207603=49, srv164879844=38, srv1110862157=7, srv135085779=16, srv1916191985=47, srv47598987=72, srv1897961096=46, srv1959649113=51, srv322831332=65, srv1217804328=12, srv1501948783=26, srv1647070779=37, srv263894148=60, srv74612556=89, srv103911323=3, srv1953446602=50, srv171296603=42, srv984981266=98, srv2033369524=53, srv977132166=97, srv597547438=77, srv85827550=92, srv586540973=76, srv987820047=99, srv1493023847=25, srv839761303=91, srv935772927=94, srv307566691=62, srv723655242=88, srv1340268596=15, srv1352884383=17, srv1517900379=29, srv1697525715=41, srv1370970527=18, srv1635252678=35, srv1488678929=24, srv1785312503=43, srv517739439=73, srv145966147=21, srv1928348576=48, srv685437756=84, srv1463603809=22, srv397586077=66, srv550249083=74, srv701263736=86, srv1115319951=8, srv1439967086=19, srv150585303=27, srv247148259=57, srv659764399=81, srv689484325=85, srv1455882751=20, srv1133467521=11, srv151276868=28, srv951750510=96, srv1465183598=23, srv1631612267=34, srv297824476=61, srv1032937838=2, srv1553449624=31, srv163947051=36, srv1870706549=45, srv1116776370=9, srv1230336724=14, srv122832308=13, srv1523610958=30, srv1080970169=4, srv251265266=58, srv679534316=83, srv1679615747=40, srv1977467432=52, srv903515295=93, srv445071434=68, srv317117159=64, srv2111077148=55} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 02:53:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 02:53:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 02:53:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 02:53:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 02:53:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 02:53:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 02:53:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 02:53:03,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 02:53:03,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 02:53:03,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 02:53:03,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 02:53:03,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 02:53:03,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 02:53:03,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 02:53:03,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 02:53:03,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 02:53:03,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 02:53:03,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 02:53:03,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 02:53:03,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 02:53:03,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 02:53:03,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 02:53:03,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 02:53:03,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 02:53:03,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 02:53:03,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 02:53:03,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 02:53:03,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 02:53:03,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 02:53:03,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 02:53:03,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-08 02:53:03,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-08 02:53:03,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-08 02:53:03,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-08 02:53:03,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-08 02:53:03,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-08 02:53:03,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-08 02:53:03,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-08 02:53:03,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-08 02:53:03,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-08 02:53:03,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-08 02:53:03,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-08 02:53:03,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-08 02:53:03,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-08 02:53:03,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-08 02:53:03,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-08 02:53:03,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-08 02:53:03,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-08 02:53:03,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-08 02:53:03,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-08 02:53:03,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-08 02:53:03,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-08 02:53:03,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-08 02:53:03,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-08 02:53:03,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-08 02:53:03,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-08 02:53:03,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-08 02:53:03,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-08 02:53:03,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-08 02:53:03,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-08 02:53:03,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-08 02:53:03,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-08 02:53:03,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-08 02:53:03,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-08 02:53:03,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-08 02:53:03,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-08 02:53:03,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-08 02:53:03,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-08 02:53:03,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-08 02:53:03,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-08 02:53:03,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-08 02:53:03,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-08 02:53:03,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-08 02:53:03,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-08 02:53:03,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-08 02:53:03,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-08 02:53:03,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-08 02:53:03,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-08 02:53:03,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-08 02:53:03,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-08 02:53:03,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-08 02:53:03,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-08 02:53:03,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-08 02:53:03,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-08 02:53:03,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-08 02:53:03,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-08 02:53:03,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-08 02:53:03,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-08 02:53:03,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-08 02:53:03,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-08 02:53:03,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-08 02:53:03,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-08 02:53:03,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-08 02:53:03,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-08 02:53:03,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-08 02:53:03,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-08 02:53:03,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-08 02:53:03,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-08 02:53:03,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-08 02:53:03,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-08 02:53:03,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-08 02:53:03,695 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:53:03,695 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-08 02:53:03,695 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.9689766728048136E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-08 02:53:03,838 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 218 ms to try 5000 different iterations.  Found a solution that moves 23 regions; Going from a computed imbalance of 3.9689766728048136E-5 to a new imbalance of 6.905118496010697E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0025555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:53:03,838 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv103911323:83 , srv1340268596:83 , srv1553449624:83 , srv631442302:83 , srv85827550:83 , srv1009040808:84 , srv1025366973:84 , srv1080970169:84 , srv1108350021:84 , srv1110862157:84 , srv1115319951:84 , srv1116776370:84 , srv1116779024:84 , srv1133467521:84 , srv1217804328:84 , srv122832308:84 , srv1230336724:84 , srv135085779:84 , srv1352884383:84 , srv1370970527:84 , srv1439967086:84 , srv1455882751:84 , srv1463603809:84 , srv1465183598:84 , srv1488678929:84 , srv1493023847:84 , srv150585303:84 , srv151276868:84 , srv1517900379:84 , srv1523610958:84 , srv1586013587:84 , srv1599219048:84 , srv1631612267:84 , srv163947051:84 , srv1647070779:84 , srv164879844:84 , srv1673477254:84 , srv1679615747:84 , srv1697525715:84 , srv171296603:84 , srv1785312503:84 , srv1862535845:84 , srv1870706549:84 , srv1897961096:84 , srv1916191985:84 , srv1928348576:84 , srv1931207603:84 , srv1953446602:84 , srv1959649113:84 , srv1977467432:84 , srv2033369524:84 , srv2035265240:84 , srv2111077148:84 , srv2139876957:84 , srv247148259:84 , srv251265266:84 , srv252031952:84 , srv263894148:84 , srv297824476:84 , srv307566691:84 , srv314427611:84 , srv317117159:84 , srv322831332:84 , srv397586077:84 , srv437429001:84 , srv445071434:84 , srv458675373:84 , srv461522617:84 , srv47598987:84 , srv517739439:84 , srv550249083:84 , srv583670124:84 , srv586540973:84 , srv597547438:84 , srv60961063:84 , srv614087704:84 , srv659764399:84 , srv667172334:84 , srv679534316:84 , srv685437756:84 , srv689484325:84 , srv701263736:84 , srv708072678:84 , srv723655242:84 , srv74612556:84 , srv801964601:84 , srv839761303:84 , srv903515295:84 , srv935772927:84 , srv941961122:84 , srv951750510:84 , srv977132166:84 , srv984981266:84 , srv987820047:84 , srv1032937838:85 , srv1099331842:85 , srv1501948783:85 , srv1635252678:85 , srv45116468:85 , srv145966147:684 }
2023-02-08 02:53:03,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 02:53:03,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv252031952=59, srv941961122=95, srv1116779024=10, srv667172334=82, srv631442302=80, srv2035265240=54, srv614087704=79, srv1673477254=39, srv60961063=78, srv583670124=75, srv45116468=69, srv801964601=90, srv1025366973=1, srv437429001=67, srv1586013587=32, srv708072678=87, srv458675373=70, srv461522617=71, srv2139876957=56, srv1099331842=5, srv1862535845=44, srv1108350021=6, srv314427611=63, srv1009040808=0, srv1599219048=33, srv1931207603=49, srv164879844=38, srv1110862157=7, srv135085779=16, srv1916191985=47, srv47598987=72, srv1897961096=46, srv1959649113=51, srv322831332=65, srv1217804328=12, srv1501948783=26, srv1647070779=37, srv263894148=60, srv74612556=89, srv103911323=3, srv1953446602=50, srv171296603=42, srv984981266=98, srv2033369524=53, srv977132166=97, srv597547438=77, srv85827550=92, srv586540973=76, srv987820047=99, srv1493023847=25, srv839761303=91, srv935772927=94, srv307566691=62, srv723655242=88, srv1340268596=15, srv1352884383=17, srv1517900379=29, srv1697525715=41, srv1370970527=18, srv1635252678=35, srv1488678929=24, srv1785312503=43, srv517739439=73, srv145966147=21, srv1928348576=48, srv685437756=84, srv1463603809=22, srv397586077=66, srv550249083=74, srv701263736=86, srv1115319951=8, srv1439967086=19, srv150585303=27, srv247148259=57, srv659764399=81, srv689484325=85, srv1455882751=20, srv1133467521=11, srv151276868=28, srv951750510=96, srv1465183598=23, srv1631612267=34, srv297824476=61, srv1032937838=2, srv1553449624=31, srv163947051=36, srv1870706549=45, srv1116776370=9, srv1230336724=14, srv122832308=13, srv1523610958=30, srv1080970169=4, srv251265266=58, srv679534316=83, srv1679615747=40, srv1977467432=52, srv903515295=93, srv445071434=68, srv317117159=64, srv2111077148=55} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 02:53:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 02:53:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-08 02:53:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-08 02:53:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-08 02:53:03,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-08 02:53:03,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-08 02:53:03,929 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:53:03,930 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv103911323:83 , srv1340268596:83 , srv1553449624:83 , srv631442302:83 , srv85827550:83 , srv1009040808:84 , srv1025366973:84 , srv1080970169:84 , srv1108350021:84 , srv1110862157:84 , srv1115319951:84 , srv1116776370:84 , srv1116779024:84 , srv1133467521:84 , srv1217804328:84 , srv122832308:84 , srv1230336724:84 , srv135085779:84 , srv1352884383:84 , srv1370970527:84 , srv1439967086:84 , srv1455882751:84 , srv1463603809:84 , srv1465183598:84 , srv1488678929:84 , srv1493023847:84 , srv150585303:84 , srv151276868:84 , srv1517900379:84 , srv1523610958:84 , srv1586013587:84 , srv1599219048:84 , srv1631612267:84 , srv163947051:84 , srv1647070779:84 , srv164879844:84 , srv1673477254:84 , srv1679615747:84 , srv1697525715:84 , srv171296603:84 , srv1785312503:84 , srv1862535845:84 , srv1870706549:84 , srv1897961096:84 , srv1916191985:84 , srv1928348576:84 , srv1931207603:84 , srv1953446602:84 , srv1959649113:84 , srv1977467432:84 , srv2033369524:84 , srv2035265240:84 , srv2111077148:84 , srv2139876957:84 , srv247148259:84 , srv251265266:84 , srv252031952:84 , srv263894148:84 , srv297824476:84 , srv307566691:84 , srv314427611:84 , srv317117159:84 , srv322831332:84 , srv397586077:84 , srv437429001:84 , srv445071434:84 , srv458675373:84 , srv461522617:84 , srv47598987:84 , srv517739439:84 , srv550249083:84 , srv583670124:84 , srv586540973:84 , srv597547438:84 , srv60961063:84 , srv614087704:84 , srv659764399:84 , srv667172334:84 , srv679534316:84 , srv685437756:84 , srv689484325:84 , srv701263736:84 , srv708072678:84 , srv723655242:84 , srv74612556:84 , srv801964601:84 , srv839761303:84 , srv903515295:84 , srv935772927:84 , srv941961122:84 , srv951750510:84 , srv977132166:84 , srv984981266:84 , srv987820047:84 , srv1032937838:85 , srv1099331842:85 , srv1501948783:85 , srv1635252678:85 , srv45116468:85 , srv145966147:684 }
2023-02-08 02:53:03,953 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=297 (was 245) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=4340 (was 4993)
2023-02-08 02:53:03,959 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=297, ProcessCount=174, AvailableMemoryMB=4340
2023-02-08 02:53:03,959 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-08 02:53:03,960 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-08 02:53:03,969 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1051448080:84 , srv1142396425:84 , srv1234257604:84 , srv1235154530:84 , srv1253481877:84 , srv127775228:84 , srv1309684936:84 , srv1428334554:84 , srv1588756839:84 , srv1594662677:84 , srv1738933292:84 , srv1890822394:84 , srv1971744452:84 , srv2019222928:84 , srv2088935656:84 , srv2117642120:84 , srv2139009369:84 , srv254394240:84 , srv34335514:84 , srv391432184:84 , srv44314025:84 , srv451399059:84 , srv544626495:84 , srv563533098:84 , srv625190622:84 , srv653613980:84 , srv768484860:84 , srv817347902:84 , srv99686430:84 , srv611717261:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-08 02:53:03,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 02:53:03,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv451399059=21, srv99686430=29, srv2088935656=14, srv1235154530=3, srv817347902=28, srv1051448080=0, srv653613980=26, srv1890822394=11, srv391432184=19, srv1234257604=2, srv254394240=17, srv44314025=20, srv1738933292=10, srv1971744452=12, srv768484860=27, srv544626495=22, srv1594662677=9, srv2139009369=16, srv127775228=5, srv2117642120=15, srv563533098=23, srv1309684936=6, srv611717261=24, srv34335514=18, srv1253481877=4, srv1588756839=8, srv625190622=25, srv2019222928=13, srv1428334554=7, srv1142396425=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 02:53:03,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 02:53:03,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 02:53:03,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 02:53:03,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 02:53:03,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 02:53:03,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 02:53:03,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 02:53:03,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 02:53:03,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 02:53:03,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 02:53:03,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 02:53:03,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 02:53:03,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 02:53:03,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 02:53:03,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 02:53:03,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 02:53:03,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 02:53:03,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 02:53:03,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-08 02:53:04,010 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1186801316471047, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:53:04,010 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912567000483837, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1186801316471047, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-08 02:55:03,989 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9543837 different iterations.  Found a solution that moves 1841 regions; Going from a computed imbalance of 0.9912567000483837 to a new imbalance of 4.296985841319951E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6818518518518518, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:55:03,994 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1051448080:90 , srv1142396425:90 , srv1234257604:90 , srv1235154530:90 , srv1253481877:90 , srv127775228:90 , srv1309684936:90 , srv1428334554:90 , srv1588756839:90 , srv1594662677:90 , srv1738933292:90 , srv1890822394:90 , srv1971744452:90 , srv2019222928:90 , srv2088935656:90 , srv2117642120:90 , srv2139009369:90 , srv254394240:90 , srv34335514:90 , srv391432184:90 , srv44314025:90 , srv451399059:90 , srv544626495:90 , srv563533098:90 , srv611717261:90 , srv625190622:90 , srv653613980:90 , srv768484860:90 , srv817347902:90 , srv99686430:90 }
2023-02-08 02:55:03,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 02:55:03,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv451399059=21, srv99686430=29, srv2088935656=14, srv1235154530=3, srv817347902=28, srv1051448080=0, srv653613980=26, srv1890822394=11, srv391432184=19, srv1234257604=2, srv254394240=17, srv44314025=20, srv1738933292=10, srv1971744452=12, srv768484860=27, srv544626495=22, srv1594662677=9, srv2139009369=16, srv127775228=5, srv2117642120=15, srv563533098=23, srv1309684936=6, srv611717261=24, srv34335514=18, srv1253481877=4, srv1588756839=8, srv625190622=25, srv2019222928=13, srv1428334554=7, srv1142396425=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 02:55:03,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 02:55:03,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-08 02:55:04,008 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 02:55:04,008 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1051448080:90 , srv1142396425:90 , srv1234257604:90 , srv1235154530:90 , srv1253481877:90 , srv127775228:90 , srv1309684936:90 , srv1428334554:90 , srv1588756839:90 , srv1594662677:90 , srv1738933292:90 , srv1890822394:90 , srv1971744452:90 , srv2019222928:90 , srv2088935656:90 , srv2117642120:90 , srv2139009369:90 , srv254394240:90 , srv34335514:90 , srv391432184:90 , srv44314025:90 , srv451399059:90 , srv544626495:90 , srv563533098:90 , srv611717261:90 , srv625190622:90 , srv653613980:90 , srv768484860:90 , srv817347902:90 , srv99686430:90 }
2023-02-08 02:55:04,031 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=213 (was 297), ProcessCount=174 (was 174), AvailableMemoryMB=3620 (was 4340)