2023-04-21 04:55:39,146 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-21 04:55:39,444 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-21 04:55:39,552 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-21 04:55:39,613 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-21 04:55:39,622 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-21 04:55:39,635 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=458, ProcessCount=172, AvailableMemoryMB=9491
2023-04-21 04:55:39,637 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-21 04:55:39,637 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-21 04:55:39,753 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000294584:84 , srv1043351385:84 , srv1048190599:84 , srv1080793373:84 , srv1085168276:84 , srv1119520446:84 , srv1166709427:84 , srv1176038038:84 , srv117788059:84 , srv1184025871:84 , srv1186878892:84 , srv1187411872:84 , srv1220944704:84 , srv1238009636:84 , srv1253571400:84 , srv1256530636:84 , srv1297198343:84 , srv1314338354:84 , srv1338318049:84 , srv142129190:84 , srv1423455726:84 , srv1429640034:84 , srv1450208083:84 , srv1482450095:84 , srv1525620178:84 , srv1526967469:84 , srv1529743733:84 , srv1534476311:84 , srv1569774896:84 , srv1583801671:84 , srv161609597:84 , srv1644252495:84 , srv1661312708:84 , srv1720745008:84 , srv1723584961:84 , srv1734753051:84 , srv1747862109:84 , srv1793783040:84 , srv1817859263:84 , srv1840625294:84 , srv1841379727:84 , srv1841841896:84 , srv1843172375:84 , srv1852547656:84 , srv1913062287:84 , srv1920327242:84 , srv1944430319:84 , srv1953991494:84 , srv1954308471:84 , srv1956894349:84 , srv1968512571:84 , srv1969613333:84 , srv2045413894:84 , srv2068122361:84 , srv2083740566:84 , srv2088143470:84 , srv210978158:84 , srv237473911:84 , srv252750820:84 , srv281215448:84 , srv287317593:84 , srv292943588:84 , srv29333330:84 , srv294367616:84 , srv297287364:84 , srv347246038:84 , srv368942923:84 , srv38685792:84 , srv397655173:84 , srv440999456:84 , srv45906814:84 , srv466025:84 , srv466819390:84 , srv498955522:84 , srv505662521:84 , srv515409543:84 , srv523482493:84 , srv53178851:84 , srv582851650:84 , srv587227198:84 , srv604838183:84 , srv618875988:84 , srv631561381:84 , srv664620114:84 , srv698832821:84 , srv699402726:84 , srv729129957:84 , srv73015020:84 , srv735585390:84 , srv74405257:84 , srv745609586:84 , srv809550276:84 , srv860250090:84 , srv890215692:84 , srv892026735:84 , srv907110832:84 , srv955663527:84 , srv959916774:84 , srv980476083:84 , srv987786947:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-21 04:55:39,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-21 04:55:39,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1661312708=32, srv1841379727=40, srv1569774896=28, srv892026735=94, srv1119520446=5, srv735585390=88, srv809550276=91, srv2045413894=52, srv38685792=67, srv74405257=89, srv587227198=79, srv1843172375=42, srv1841841896=41, srv1920327242=45, srv1166709427=6, srv505662521=74, srv1529743733=26, srv142129190=19, srv1429640034=21, srv604838183=80, srv1734753051=35, srv281215448=59, srv29333330=62, srv618875988=81, srv860250090=92, srv1720745008=33, srv1184025871=9, srv466025=71, srv252750820=58, srv1220944704=12, srv980476083=98, srv1840625294=39, srv1968512571=50, srv1186878892=10, srv729129957=86, srv1000294584=0, srv2083740566=54, srv297287364=64, srv1085168276=4, srv440999456=69, srv1852547656=43, srv1043351385=1, srv1525620178=24, srv237473911=57, srv73015020=87, srv161609597=30, srv1944430319=46, srv1534476311=27, srv117788059=8, srv959916774=97, srv1238009636=13, srv1256530636=15, srv955663527=96, srv523482493=76, srv397655173=68, srv1314338354=17, srv1817859263=38, srv1176038038=7, srv1297198343=16, srv1723584961=34, srv698832821=84, srv1187411872=11, srv907110832=95, srv1253571400=14, srv1956894349=49, srv1080793373=3, srv1954308471=48, srv1423455726=20, srv2088143470=55, srv515409543=75, srv987786947=99, srv1482450095=23, srv1953991494=47, srv1969613333=51, srv294367616=63, srv292943588=61, srv1338318049=18, srv1644252495=31, srv699402726=85, srv745609586=90, srv1583801671=29, srv1048190599=2, srv45906814=70, srv890215692=93, srv664620114=83, srv466819390=72, srv498955522=73, srv1450208083=22, srv287317593=60, srv1913062287=44, srv1793783040=37, srv347246038=65, srv1747862109=36, srv1526967469=25, srv53178851=77, srv582851650=78, srv631561381=82, srv210978158=56, srv2068122361=53, srv368942923=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-21 04:55:39,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-21 04:55:39,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-21 04:55:39,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-21 04:55:39,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-21 04:55:39,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-21 04:55:39,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-21 04:55:39,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-21 04:55:39,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-21 04:55:39,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-21 04:55:39,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-21 04:55:39,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-21 04:55:39,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-21 04:55:39,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-21 04:55:39,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-21 04:55:39,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-21 04:55:39,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-21 04:55:39,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-21 04:55:39,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-21 04:55:39,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-21 04:55:39,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-21 04:55:39,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-21 04:55:39,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-21 04:55:39,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-21 04:55:39,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-21 04:55:39,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-21 04:55:39,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-21 04:55:39,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-21 04:55:39,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-21 04:55:39,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-21 04:55:39,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-21 04:55:39,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-21 04:55:39,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-21 04:55:39,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-21 04:55:39,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-21 04:55:39,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-21 04:55:39,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-21 04:55:39,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-21 04:55:39,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-21 04:55:39,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-21 04:55:39,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-21 04:55:39,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-21 04:55:39,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-21 04:55:39,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-21 04:55:39,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-21 04:55:39,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-21 04:55:39,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-21 04:55:39,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-21 04:55:39,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-21 04:55:39,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-21 04:55:39,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-21 04:55:39,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-21 04:55:39,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-21 04:55:39,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-21 04:55:39,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-21 04:55:39,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-21 04:55:39,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-21 04:55:39,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-21 04:55:39,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-21 04:55:39,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-21 04:55:39,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-21 04:55:39,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-21 04:55:39,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-21 04:55:39,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-21 04:55:39,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-21 04:55:39,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-21 04:55:39,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-21 04:55:39,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-21 04:55:39,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-21 04:55:39,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-21 04:55:39,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-21 04:55:39,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-21 04:55:39,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-21 04:55:39,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-21 04:55:39,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-21 04:55:39,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-21 04:55:39,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-21 04:55:39,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-21 04:55:39,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-21 04:55:39,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-21 04:55:39,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-21 04:55:39,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-21 04:55:39,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-21 04:55:39,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-21 04:55:39,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-21 04:55:39,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-21 04:55:39,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-21 04:55:39,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-21 04:55:39,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-21 04:55:39,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-21 04:55:40,161 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:55:40,161 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-21 04:55:40,161 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-21 04:55:40,506 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 604 ms to try 5000 different iterations.  Found a solution that moves 4660 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18527732120386825. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04016799737935678, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05320270197268334, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5177777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04016799737935678, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18075, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24533333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:55:40,528 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1166709427:83 , srv1253571400:83 , srv1338318049:83 , srv1450208083:83 , srv1526967469:83 , srv161609597:83 , srv1944430319:83 , srv1954308471:83 , srv210978158:83 , srv38685792:83 , srv582851650:83 , srv618875988:83 , srv729129957:83 , srv73015020:83 , srv890215692:83 , srv117788059:84 , srv1793783040:84 , srv1913062287:84 , srv2083740566:84 , srv237473911:84 , srv281215448:84 , srv29333330:84 , srv892026735:84 , srv1000294584:85 , srv1085168276:85 , srv1184025871:85 , srv1297198343:85 , srv1529743733:85 , srv1661312708:85 , srv1747862109:85 , srv1840625294:85 , srv1956894349:85 , srv1969613333:85 , srv2088143470:85 , srv292943588:85 , srv294367616:85 , srv397655173:85 , srv440999456:85 , srv466819390:85 , srv980476083:85 , srv1119520446:86 , srv1186878892:86 , srv1187411872:86 , srv1525620178:86 , srv1723584961:86 , srv1843172375:86 , srv1920327242:86 , srv1968512571:86 , srv368942923:86 , srv664620114:86 , srv745609586:86 , srv860250090:86 , srv1043351385:87 , srv1080793373:87 , srv142129190:87 , srv1569774896:87 , srv1720745008:87 , srv1734753051:87 , srv1817859263:87 , srv1852547656:87 , srv1953991494:87 , srv2045413894:87 , srv2068122361:87 , srv252750820:87 , srv45906814:87 , srv466025:87 , srv505662521:87 , srv631561381:87 , srv699402726:87 , srv735585390:87 , srv1314338354:88 , srv1429640034:88 , srv1482450095:88 , srv1534476311:88 , srv1583801671:88 , srv1644252495:88 , srv1841379727:88 , srv515409543:88 , srv523482493:88 , srv587227198:88 , srv809550276:88 , srv907110832:88 , srv959916774:88 , srv1176038038:89 , srv1238009636:89 , srv347246038:89 , srv604838183:89 , srv955663527:89 , srv1220944704:90 , srv1256530636:90 , srv1423455726:90 , srv498955522:90 , srv53178851:90 , srv74405257:90 , srv1048190599:91 , srv287317593:91 , srv297287364:91 , srv698832821:93 , srv1841841896:98 , srv987786947:447 }
2023-04-21 04:55:40,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-21 04:55:40,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1661312708=32, srv1841379727=40, srv1569774896=28, srv892026735=94, srv1119520446=5, srv735585390=88, srv809550276=91, srv2045413894=52, srv38685792=67, srv74405257=89, srv587227198=79, srv1843172375=42, srv1841841896=41, srv1920327242=45, srv1166709427=6, srv505662521=74, srv1529743733=26, srv142129190=19, srv1429640034=21, srv604838183=80, srv1734753051=35, srv281215448=59, srv29333330=62, srv618875988=81, srv860250090=92, srv1720745008=33, srv1184025871=9, srv466025=71, srv252750820=58, srv1220944704=12, srv980476083=98, srv1840625294=39, srv1968512571=50, srv1186878892=10, srv729129957=86, srv1000294584=0, srv2083740566=54, srv297287364=64, srv1085168276=4, srv440999456=69, srv1852547656=43, srv1043351385=1, srv1525620178=24, srv237473911=57, srv73015020=87, srv161609597=30, srv1944430319=46, srv1534476311=27, srv117788059=8, srv959916774=97, srv1238009636=13, srv1256530636=15, srv955663527=96, srv523482493=76, srv397655173=68, srv1314338354=17, srv1817859263=38, srv1176038038=7, srv1297198343=16, srv1723584961=34, srv698832821=84, srv1187411872=11, srv907110832=95, srv1253571400=14, srv1956894349=49, srv1080793373=3, srv1954308471=48, srv1423455726=20, srv2088143470=55, srv515409543=75, srv987786947=99, srv1482450095=23, srv1953991494=47, srv1969613333=51, srv294367616=63, srv292943588=61, srv1338318049=18, srv1644252495=31, srv699402726=85, srv745609586=90, srv1583801671=29, srv1048190599=2, srv45906814=70, srv890215692=93, srv664620114=83, srv466819390=72, srv498955522=73, srv1450208083=22, srv287317593=60, srv1913062287=44, srv1793783040=37, srv347246038=65, srv1747862109=36, srv1526967469=25, srv53178851=77, srv582851650=78, srv631561381=82, srv210978158=56, srv2068122361=53, srv368942923=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-21 04:55:40,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-21 04:55:40,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-21 04:55:40,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-21 04:55:40,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-21 04:55:40,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-21 04:55:40,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-21 04:55:40,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-21 04:55:40,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-21 04:55:40,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-21 04:55:40,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-21 04:55:40,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-21 04:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-21 04:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-21 04:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-21 04:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-21 04:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-21 04:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-21 04:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-21 04:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-21 04:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-21 04:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-21 04:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-21 04:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-21 04:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-21 04:55:40,709 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04016799737935678, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05320270197268334, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04016799737935678, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18075, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24533333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:55:40,710 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-21 04:55:40,710 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1852446911864529, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04016799737935678, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05320270197268334, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04016799737935678, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18075, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24533333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-21 04:55:41,053 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 469 ms to try 5000 different iterations.  Found a solution that moves 2652 regions; Going from a computed imbalance of 0.1852446911864529 to a new imbalance of 0.014192251101338723. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021385481530743777); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03085755259557297, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2946666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021385481530743777); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:55:41,067 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1841841896:75 , srv1048190599:80 , srv287317593:80 , srv297287364:80 , srv698832821:80 , srv1220944704:81 , srv53178851:81 , srv74405257:81 , srv1176038038:82 , srv1256530636:82 , srv1429640034:82 , srv1482450095:82 , srv347246038:82 , srv809550276:82 , srv1314338354:83 , srv1423455726:83 , srv1841379727:83 , srv252750820:83 , srv498955522:83 , srv735585390:83 , srv955663527:83 , srv1297198343:84 , srv142129190:84 , srv1852547656:84 , srv1953991494:84 , srv2068122361:84 , srv604838183:84 , srv907110832:84 , srv959916774:84 , srv1043351385:85 , srv1085168276:85 , srv1187411872:85 , srv1569774896:85 , srv1583801671:85 , srv1720745008:85 , srv1817859263:85 , srv505662521:85 , srv631561381:85 , srv1000294584:86 , srv1080793373:86 , srv1238009636:86 , srv1644252495:86 , srv1723584961:86 , srv1734753051:86 , srv1747862109:86 , srv1793783040:86 , srv1968512571:86 , srv292943588:86 , srv368942923:86 , srv397655173:86 , srv45906814:86 , srv466819390:86 , srv515409543:86 , srv618875988:86 , srv664620114:86 , srv699402726:86 , srv1119520446:87 , srv1186878892:87 , srv1525620178:87 , srv1526967469:87 , srv1529743733:87 , srv1534476311:87 , srv1661312708:87 , srv1840625294:87 , srv1843172375:87 , srv1969613333:87 , srv2045413894:87 , srv29333330:87 , srv294367616:87 , srv38685792:87 , srv466025:87 , srv523482493:87 , srv587227198:87 , srv73015020:87 , srv745609586:87 , srv980476083:87 , srv117788059:88 , srv1253571400:88 , srv1944430319:88 , srv1954308471:88 , srv2088143470:88 , srv440999456:88 , srv582851650:88 , srv729129957:88 , srv1184025871:89 , srv1338318049:89 , srv1450208083:89 , srv1920327242:89 , srv210978158:89 , srv237473911:89 , srv281215448:89 , srv860250090:89 , srv890215692:89 , srv892026735:89 , srv161609597:90 , srv1956894349:90 , srv2083740566:90 , srv1913062287:91 , srv1166709427:92 , srv987786947:517 }
2023-04-21 04:55:41,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-21 04:55:41,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1661312708=32, srv1841379727=40, srv1569774896=28, srv892026735=94, srv1119520446=5, srv735585390=88, srv809550276=91, srv2045413894=52, srv38685792=67, srv74405257=89, srv587227198=79, srv1843172375=42, srv1841841896=41, srv1920327242=45, srv1166709427=6, srv505662521=74, srv1529743733=26, srv142129190=19, srv1429640034=21, srv604838183=80, srv1734753051=35, srv281215448=59, srv29333330=62, srv618875988=81, srv860250090=92, srv1720745008=33, srv1184025871=9, srv466025=71, srv252750820=58, srv1220944704=12, srv980476083=98, srv1840625294=39, srv1968512571=50, srv1186878892=10, srv729129957=86, srv1000294584=0, srv2083740566=54, srv297287364=64, srv1085168276=4, srv440999456=69, srv1852547656=43, srv1043351385=1, srv1525620178=24, srv237473911=57, srv73015020=87, srv161609597=30, srv1944430319=46, srv1534476311=27, srv117788059=8, srv959916774=97, srv1238009636=13, srv1256530636=15, srv955663527=96, srv523482493=76, srv397655173=68, srv1314338354=17, srv1817859263=38, srv1176038038=7, srv1297198343=16, srv1723584961=34, srv698832821=84, srv1187411872=11, srv907110832=95, srv1253571400=14, srv1956894349=49, srv1080793373=3, srv1954308471=48, srv1423455726=20, srv2088143470=55, srv515409543=75, srv987786947=99, srv1482450095=23, srv1953991494=47, srv1969613333=51, srv294367616=63, srv292943588=61, srv1338318049=18, srv1644252495=31, srv699402726=85, srv745609586=90, srv1583801671=29, srv1048190599=2, srv45906814=70, srv890215692=93, srv664620114=83, srv466819390=72, srv498955522=73, srv1450208083=22, srv287317593=60, srv1913062287=44, srv1793783040=37, srv347246038=65, srv1747862109=36, srv1526967469=25, srv53178851=77, srv582851650=78, srv631561381=82, srv210978158=56, srv2068122361=53, srv368942923=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-21 04:55:41,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-21 04:55:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-21 04:55:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-21 04:55:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-21 04:55:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-21 04:55:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-21 04:55:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-21 04:55:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-21 04:55:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-21 04:55:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-21 04:55:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-21 04:55:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-21 04:55:41,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-21 04:55:41,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-21 04:55:41,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-21 04:55:41,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-21 04:55:41,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-21 04:55:41,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-21 04:55:41,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-21 04:55:41,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-21 04:55:41,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-21 04:55:41,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-21 04:55:41,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-21 04:55:41,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-21 04:55:41,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-21 04:55:41,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-21 04:55:41,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-21 04:55:41,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-21 04:55:41,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-21 04:55:41,248 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021385481530743777); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03085755259557297, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021385481530743777); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:55:41,248 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-21 04:55:41,248 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014173681400440548, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021385481530743777); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03085755259557297, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021385481530743777); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043083333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-21 04:55:41,537 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 425 ms to try 5000 different iterations.  Found a solution that moves 976 regions; Going from a computed imbalance of 0.014173681400440548 to a new imbalance of 5.163780723955877E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004112157478995831); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005463890236888291); MoveCostFunction : (multiplier=7.0, imbalance=0.10844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004112157478995831); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0026666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:55:41,538 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1238009636:82 , srv1920327242:82 , srv523482493:82 , srv587227198:82 , srv860250090:82 , srv1166709427:83 , srv1184025871:83 , srv1644252495:83 , srv1913062287:83 , srv1956894349:83 , srv466025:83 , srv515409543:83 , srv1186878892:84 , srv1423455726:84 , srv1525620178:84 , srv1583801671:84 , srv161609597:84 , srv2045413894:84 , srv2083740566:84 , srv2088143470:84 , srv237473911:84 , srv440999456:84 , srv498955522:84 , srv699402726:84 , srv1043351385:85 , srv1256530636:85 , srv1534476311:85 , srv1720745008:85 , srv1723584961:85 , srv1734753051:85 , srv1817859263:85 , srv1841841896:85 , srv1968512571:85 , srv1969613333:85 , srv281215448:85 , srv294367616:85 , srv45906814:85 , srv505662521:85 , srv604838183:85 , srv664620114:85 , srv698832821:85 , srv745609586:85 , srv890215692:85 , srv892026735:85 , srv955663527:85 , srv980476083:85 , srv1000294584:86 , srv1080793373:86 , srv1119520446:86 , srv1176038038:86 , srv1187411872:86 , srv1220944704:86 , srv1338318049:86 , srv142129190:86 , srv1450208083:86 , srv1529743733:86 , srv1569774896:86 , srv1661312708:86 , srv1747862109:86 , srv1840625294:86 , srv1841379727:86 , srv1843172375:86 , srv1953991494:86 , srv2068122361:86 , srv210978158:86 , srv287317593:86 , srv297287364:86 , srv347246038:86 , srv631561381:86 , srv907110832:86 , srv959916774:86 , srv1085168276:87 , srv117788059:87 , srv1314338354:87 , srv1429640034:87 , srv1852547656:87 , srv1944430319:87 , srv1954308471:87 , srv292943588:87 , srv29333330:87 , srv368942923:87 , srv397655173:87 , srv53178851:87 , srv582851650:87 , srv729129957:87 , srv74405257:87 , srv1048190599:88 , srv1253571400:88 , srv1297198343:88 , srv1482450095:88 , srv1526967469:88 , srv252750820:88 , srv38685792:88 , srv466819390:88 , srv73015020:88 , srv735585390:88 , srv809550276:88 , srv1793783040:89 , srv618875988:89 , srv987786947:530 }
2023-04-21 04:55:41,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-21 04:55:41,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1661312708=32, srv1841379727=40, srv1569774896=28, srv892026735=94, srv1119520446=5, srv735585390=88, srv809550276=91, srv2045413894=52, srv38685792=67, srv74405257=89, srv587227198=79, srv1843172375=42, srv1841841896=41, srv1920327242=45, srv1166709427=6, srv505662521=74, srv1529743733=26, srv142129190=19, srv1429640034=21, srv604838183=80, srv1734753051=35, srv281215448=59, srv29333330=62, srv618875988=81, srv860250090=92, srv1720745008=33, srv1184025871=9, srv466025=71, srv252750820=58, srv1220944704=12, srv980476083=98, srv1840625294=39, srv1968512571=50, srv1186878892=10, srv729129957=86, srv1000294584=0, srv2083740566=54, srv297287364=64, srv1085168276=4, srv440999456=69, srv1852547656=43, srv1043351385=1, srv1525620178=24, srv237473911=57, srv73015020=87, srv161609597=30, srv1944430319=46, srv1534476311=27, srv117788059=8, srv959916774=97, srv1238009636=13, srv1256530636=15, srv955663527=96, srv523482493=76, srv397655173=68, srv1314338354=17, srv1817859263=38, srv1176038038=7, srv1297198343=16, srv1723584961=34, srv698832821=84, srv1187411872=11, srv907110832=95, srv1253571400=14, srv1956894349=49, srv1080793373=3, srv1954308471=48, srv1423455726=20, srv2088143470=55, srv515409543=75, srv987786947=99, srv1482450095=23, srv1953991494=47, srv1969613333=51, srv294367616=63, srv292943588=61, srv1338318049=18, srv1644252495=31, srv699402726=85, srv745609586=90, srv1583801671=29, srv1048190599=2, srv45906814=70, srv890215692=93, srv664620114=83, srv466819390=72, srv498955522=73, srv1450208083=22, srv287317593=60, srv1913062287=44, srv1793783040=37, srv347246038=65, srv1747862109=36, srv1526967469=25, srv53178851=77, srv582851650=78, srv631561381=82, srv210978158=56, srv2068122361=53, srv368942923=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-21 04:55:41,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-21 04:55:41,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-21 04:55:41,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-21 04:55:41,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-21 04:55:41,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-21 04:55:41,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-21 04:55:41,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-21 04:55:41,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-21 04:55:41,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-21 04:55:41,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-21 04:55:41,673 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004112157478995831); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005463890236888291); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004112157478995831); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0026666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:55:41,673 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-21 04:55:41,674 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.095439743274808E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004112157478995831); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005463890236888291); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004112157478995831); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0026666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-21 04:55:41,948 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 365 ms to try 5000 different iterations.  Found a solution that moves 193 regions; Going from a computed imbalance of 5.095439743274808E-4 to a new imbalance of 2.5566741914295785E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.021444444444444443); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:55:41,949 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1534476311:82 , srv1048190599:83 , srv1080793373:83 , srv1119520446:83 , srv117788059:83 , srv1253571400:83 , srv1526967469:83 , srv1793783040:83 , srv1843172375:83 , srv1166709427:84 , srv1176038038:84 , srv1187411872:84 , srv1314338354:84 , srv1338318049:84 , srv1450208083:84 , srv1482450095:84 , srv1529743733:84 , srv1569774896:84 , srv1661312708:84 , srv1734753051:84 , srv1840625294:84 , srv1841841896:84 , srv1852547656:84 , srv1913062287:84 , srv1944430319:84 , srv1954308471:84 , srv1956894349:84 , srv2045413894:84 , srv2083740566:84 , srv210978158:84 , srv252750820:84 , srv281215448:84 , srv292943588:84 , srv29333330:84 , srv368942923:84 , srv38685792:84 , srv397655173:84 , srv45906814:84 , srv466819390:84 , srv53178851:84 , srv582851650:84 , srv587227198:84 , srv618875988:84 , srv631561381:84 , srv698832821:84 , srv729129957:84 , srv73015020:84 , srv735585390:84 , srv74405257:84 , srv809550276:84 , srv892026735:84 , srv907110832:84 , srv959916774:84 , srv1000294584:85 , srv1043351385:85 , srv1085168276:85 , srv1184025871:85 , srv1186878892:85 , srv1220944704:85 , srv1238009636:85 , srv1256530636:85 , srv1297198343:85 , srv142129190:85 , srv1423455726:85 , srv1429640034:85 , srv1525620178:85 , srv1583801671:85 , srv161609597:85 , srv1644252495:85 , srv1720745008:85 , srv1723584961:85 , srv1747862109:85 , srv1817859263:85 , srv1841379727:85 , srv1920327242:85 , srv1953991494:85 , srv1968512571:85 , srv1969613333:85 , srv2068122361:85 , srv2088143470:85 , srv237473911:85 , srv287317593:85 , srv294367616:85 , srv297287364:85 , srv347246038:85 , srv440999456:85 , srv466025:85 , srv498955522:85 , srv505662521:85 , srv515409543:85 , srv523482493:85 , srv604838183:85 , srv664620114:85 , srv699402726:85 , srv745609586:85 , srv860250090:85 , srv890215692:85 , srv955663527:85 , srv980476083:85 , srv987786947:648 }
2023-04-21 04:55:41,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-21 04:55:41,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1661312708=32, srv1841379727=40, srv1569774896=28, srv892026735=94, srv1119520446=5, srv735585390=88, srv809550276=91, srv2045413894=52, srv38685792=67, srv74405257=89, srv587227198=79, srv1843172375=42, srv1841841896=41, srv1920327242=45, srv1166709427=6, srv505662521=74, srv1529743733=26, srv142129190=19, srv1429640034=21, srv604838183=80, srv1734753051=35, srv281215448=59, srv29333330=62, srv618875988=81, srv860250090=92, srv1720745008=33, srv1184025871=9, srv466025=71, srv252750820=58, srv1220944704=12, srv980476083=98, srv1840625294=39, srv1968512571=50, srv1186878892=10, srv729129957=86, srv1000294584=0, srv2083740566=54, srv297287364=64, srv1085168276=4, srv440999456=69, srv1852547656=43, srv1043351385=1, srv1525620178=24, srv237473911=57, srv73015020=87, srv161609597=30, srv1944430319=46, srv1534476311=27, srv117788059=8, srv959916774=97, srv1238009636=13, srv1256530636=15, srv955663527=96, srv523482493=76, srv397655173=68, srv1314338354=17, srv1817859263=38, srv1176038038=7, srv1297198343=16, srv1723584961=34, srv698832821=84, srv1187411872=11, srv907110832=95, srv1253571400=14, srv1956894349=49, srv1080793373=3, srv1954308471=48, srv1423455726=20, srv2088143470=55, srv515409543=75, srv987786947=99, srv1482450095=23, srv1953991494=47, srv1969613333=51, srv294367616=63, srv292943588=61, srv1338318049=18, srv1644252495=31, srv699402726=85, srv745609586=90, srv1583801671=29, srv1048190599=2, srv45906814=70, srv890215692=93, srv664620114=83, srv466819390=72, srv498955522=73, srv1450208083=22, srv287317593=60, srv1913062287=44, srv1793783040=37, srv347246038=65, srv1747862109=36, srv1526967469=25, srv53178851=77, srv582851650=78, srv631561381=82, srv210978158=56, srv2068122361=53, srv368942923=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-21 04:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-21 04:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-21 04:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-21 04:55:41,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-21 04:55:41,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-21 04:55:41,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-21 04:55:41,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-21 04:55:41,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-21 04:55:41,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-21 04:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-21 04:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-21 04:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-21 04:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-21 04:55:41,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-21 04:55:42,067 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:55:42,067 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-21 04:55:42,067 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.421532702992628E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-21 04:55:42,303 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 326 ms to try 5000 different iterations.  Found a solution that moves 18 regions; Going from a computed imbalance of 2.421532702992628E-5 to a new imbalance of 6.870107747710969E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.002); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:55:42,303 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv368942923:83 , srv466819390:83 , srv604838183:83 , srv745609586:83 , srv1000294584:84 , srv1043351385:84 , srv1048190599:84 , srv1080793373:84 , srv1085168276:84 , srv1119520446:84 , srv1166709427:84 , srv117788059:84 , srv1184025871:84 , srv1186878892:84 , srv1220944704:84 , srv1238009636:84 , srv1253571400:84 , srv1256530636:84 , srv1297198343:84 , srv1314338354:84 , srv1338318049:84 , srv142129190:84 , srv1423455726:84 , srv1429640034:84 , srv1450208083:84 , srv1482450095:84 , srv1525620178:84 , srv1529743733:84 , srv1534476311:84 , srv1569774896:84 , srv1583801671:84 , srv161609597:84 , srv1644252495:84 , srv1661312708:84 , srv1720745008:84 , srv1723584961:84 , srv1734753051:84 , srv1747862109:84 , srv1793783040:84 , srv1817859263:84 , srv1840625294:84 , srv1841379727:84 , srv1841841896:84 , srv1843172375:84 , srv1852547656:84 , srv1913062287:84 , srv1920327242:84 , srv1944430319:84 , srv1953991494:84 , srv1954308471:84 , srv1956894349:84 , srv1968512571:84 , srv1969613333:84 , srv2045413894:84 , srv2068122361:84 , srv2083740566:84 , srv2088143470:84 , srv210978158:84 , srv237473911:84 , srv252750820:84 , srv281215448:84 , srv287317593:84 , srv292943588:84 , srv29333330:84 , srv294367616:84 , srv297287364:84 , srv347246038:84 , srv38685792:84 , srv397655173:84 , srv440999456:84 , srv45906814:84 , srv466025:84 , srv498955522:84 , srv505662521:84 , srv515409543:84 , srv523482493:84 , srv53178851:84 , srv582851650:84 , srv618875988:84 , srv631561381:84 , srv664620114:84 , srv698832821:84 , srv699402726:84 , srv729129957:84 , srv73015020:84 , srv735585390:84 , srv74405257:84 , srv809550276:84 , srv860250090:84 , srv890215692:84 , srv892026735:84 , srv907110832:84 , srv955663527:84 , srv959916774:84 , srv980476083:84 , srv1176038038:85 , srv1187411872:85 , srv1526967469:85 , srv587227198:85 , srv987786947:684 }
2023-04-21 04:55:42,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-21 04:55:42,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1661312708=32, srv1841379727=40, srv1569774896=28, srv892026735=94, srv1119520446=5, srv735585390=88, srv809550276=91, srv2045413894=52, srv38685792=67, srv74405257=89, srv587227198=79, srv1843172375=42, srv1841841896=41, srv1920327242=45, srv1166709427=6, srv505662521=74, srv1529743733=26, srv142129190=19, srv1429640034=21, srv604838183=80, srv1734753051=35, srv281215448=59, srv29333330=62, srv618875988=81, srv860250090=92, srv1720745008=33, srv1184025871=9, srv466025=71, srv252750820=58, srv1220944704=12, srv980476083=98, srv1840625294=39, srv1968512571=50, srv1186878892=10, srv729129957=86, srv1000294584=0, srv2083740566=54, srv297287364=64, srv1085168276=4, srv440999456=69, srv1852547656=43, srv1043351385=1, srv1525620178=24, srv237473911=57, srv73015020=87, srv161609597=30, srv1944430319=46, srv1534476311=27, srv117788059=8, srv959916774=97, srv1238009636=13, srv1256530636=15, srv955663527=96, srv523482493=76, srv397655173=68, srv1314338354=17, srv1817859263=38, srv1176038038=7, srv1297198343=16, srv1723584961=34, srv698832821=84, srv1187411872=11, srv907110832=95, srv1253571400=14, srv1956894349=49, srv1080793373=3, srv1954308471=48, srv1423455726=20, srv2088143470=55, srv515409543=75, srv987786947=99, srv1482450095=23, srv1953991494=47, srv1969613333=51, srv294367616=63, srv292943588=61, srv1338318049=18, srv1644252495=31, srv699402726=85, srv745609586=90, srv1583801671=29, srv1048190599=2, srv45906814=70, srv890215692=93, srv664620114=83, srv466819390=72, srv498955522=73, srv1450208083=22, srv287317593=60, srv1913062287=44, srv1793783040=37, srv347246038=65, srv1747862109=36, srv1526967469=25, srv53178851=77, srv582851650=78, srv631561381=82, srv210978158=56, srv2068122361=53, srv368942923=66} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-21 04:55:42,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-21 04:55:42,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-21 04:55:42,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-21 04:55:42,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-21 04:55:42,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-21 04:55:42,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-21 04:55:42,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-21 04:55:42,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-21 04:55:42,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-21 04:55:42,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-21 04:55:42,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-21 04:55:42,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-21 04:55:42,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-21 04:55:42,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-21 04:55:42,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-21 04:55:42,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-21 04:55:42,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-21 04:55:42,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-21 04:55:42,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-21 04:55:42,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-21 04:55:42,422 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:55:42,423 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv368942923:83 , srv466819390:83 , srv604838183:83 , srv745609586:83 , srv1000294584:84 , srv1043351385:84 , srv1048190599:84 , srv1080793373:84 , srv1085168276:84 , srv1119520446:84 , srv1166709427:84 , srv117788059:84 , srv1184025871:84 , srv1186878892:84 , srv1220944704:84 , srv1238009636:84 , srv1253571400:84 , srv1256530636:84 , srv1297198343:84 , srv1314338354:84 , srv1338318049:84 , srv142129190:84 , srv1423455726:84 , srv1429640034:84 , srv1450208083:84 , srv1482450095:84 , srv1525620178:84 , srv1529743733:84 , srv1534476311:84 , srv1569774896:84 , srv1583801671:84 , srv161609597:84 , srv1644252495:84 , srv1661312708:84 , srv1720745008:84 , srv1723584961:84 , srv1734753051:84 , srv1747862109:84 , srv1793783040:84 , srv1817859263:84 , srv1840625294:84 , srv1841379727:84 , srv1841841896:84 , srv1843172375:84 , srv1852547656:84 , srv1913062287:84 , srv1920327242:84 , srv1944430319:84 , srv1953991494:84 , srv1954308471:84 , srv1956894349:84 , srv1968512571:84 , srv1969613333:84 , srv2045413894:84 , srv2068122361:84 , srv2083740566:84 , srv2088143470:84 , srv210978158:84 , srv237473911:84 , srv252750820:84 , srv281215448:84 , srv287317593:84 , srv292943588:84 , srv29333330:84 , srv294367616:84 , srv297287364:84 , srv347246038:84 , srv38685792:84 , srv397655173:84 , srv440999456:84 , srv45906814:84 , srv466025:84 , srv498955522:84 , srv505662521:84 , srv515409543:84 , srv523482493:84 , srv53178851:84 , srv582851650:84 , srv618875988:84 , srv631561381:84 , srv664620114:84 , srv698832821:84 , srv699402726:84 , srv729129957:84 , srv73015020:84 , srv735585390:84 , srv74405257:84 , srv809550276:84 , srv860250090:84 , srv890215692:84 , srv892026735:84 , srv907110832:84 , srv955663527:84 , srv959916774:84 , srv980476083:84 , srv1176038038:85 , srv1187411872:85 , srv1526967469:85 , srv587227198:85 , srv987786947:684 }
2023-04-21 04:55:42,445 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=430 (was 458), ProcessCount=172 (was 172), AvailableMemoryMB=8993 (was 9491)
2023-04-21 04:55:42,453 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=172, AvailableMemoryMB=8993
2023-04-21 04:55:42,453 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-21 04:55:42,454 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-21 04:55:42,460 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1013405746:84 , srv1025743993:84 , srv1121670322:84 , srv1176627251:84 , srv1194286628:84 , srv1305651411:84 , srv1356017010:84 , srv1508979814:84 , srv154098181:84 , srv1646592003:84 , srv1649959724:84 , srv1674328033:84 , srv1679181957:84 , srv173309508:84 , srv1808877379:84 , srv1843259943:84 , srv1952890200:84 , srv2123970703:84 , srv343151914:84 , srv368807607:84 , srv406119279:84 , srv430906175:84 , srv540610835:84 , srv678157523:84 , srv768157464:84 , srv795375799:84 , srv80139887:84 , srv894194145:84 , srv923348315:84 , srv1813794078:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-21 04:55:42,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-21 04:55:42,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv80139887=27, srv1121670322=2, srv430906175=22, srv1356017010=6, srv795375799=26, srv1813794078=15, srv1808877379=14, srv678157523=24, srv1025743993=1, srv1194286628=4, srv768157464=25, srv343151914=19, srv1176627251=3, srv2123970703=18, srv1508979814=7, srv154098181=8, srv894194145=28, srv1674328033=11, srv1646592003=9, srv1679181957=12, srv1843259943=16, srv406119279=21, srv173309508=13, srv1013405746=0, srv923348315=29, srv1952890200=17, srv1649959724=10, srv368807607=20, srv1305651411=5, srv540610835=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-21 04:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-21 04:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-21 04:55:42,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-21 04:55:42,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-21 04:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-21 04:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-21 04:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-21 04:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-21 04:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-21 04:55:42,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-21 04:55:42,485 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.09004900472314, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:55:42,485 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912476784737793, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.09004900472314, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-21 04:57:42,474 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5440890 different iterations.  Found a solution that moves 1871 regions; Going from a computed imbalance of 0.9912476784737793 to a new imbalance of 4.367007337919408E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.692962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:57:42,481 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1013405746:90 , srv1025743993:90 , srv1121670322:90 , srv1176627251:90 , srv1194286628:90 , srv1305651411:90 , srv1356017010:90 , srv1508979814:90 , srv154098181:90 , srv1646592003:90 , srv1649959724:90 , srv1674328033:90 , srv1679181957:90 , srv173309508:90 , srv1808877379:90 , srv1813794078:90 , srv1843259943:90 , srv1952890200:90 , srv2123970703:90 , srv343151914:90 , srv368807607:90 , srv406119279:90 , srv430906175:90 , srv540610835:90 , srv678157523:90 , srv768157464:90 , srv795375799:90 , srv80139887:90 , srv894194145:90 , srv923348315:90 }
2023-04-21 04:57:42,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-21 04:57:42,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv80139887=27, srv1121670322=2, srv430906175=22, srv1356017010=6, srv795375799=26, srv1813794078=15, srv1808877379=14, srv678157523=24, srv1025743993=1, srv1194286628=4, srv768157464=25, srv343151914=19, srv1176627251=3, srv2123970703=18, srv1508979814=7, srv154098181=8, srv894194145=28, srv1674328033=11, srv1646592003=9, srv1679181957=12, srv1843259943=16, srv406119279=21, srv173309508=13, srv1013405746=0, srv923348315=29, srv1952890200=17, srv1649959724=10, srv368807607=20, srv1305651411=5, srv540610835=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-21 04:57:42,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-21 04:57:42,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-21 04:57:42,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-21 04:57:42,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-21 04:57:42,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-21 04:57:42,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-21 04:57:42,502 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-21 04:57:42,502 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1013405746:90 , srv1025743993:90 , srv1121670322:90 , srv1176627251:90 , srv1194286628:90 , srv1305651411:90 , srv1356017010:90 , srv1508979814:90 , srv154098181:90 , srv1646592003:90 , srv1649959724:90 , srv1674328033:90 , srv1679181957:90 , srv173309508:90 , srv1808877379:90 , srv1813794078:90 , srv1843259943:90 , srv1952890200:90 , srv2123970703:90 , srv343151914:90 , srv368807607:90 , srv406119279:90 , srv430906175:90 , srv540610835:90 , srv678157523:90 , srv768157464:90 , srv795375799:90 , srv80139887:90 , srv894194145:90 , srv923348315:90 }
2023-04-21 04:57:42,515 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=326 (was 430), ProcessCount=171 (was 172), AvailableMemoryMB=9243 (was 8993) - AvailableMemoryMB LEAK? -